-- Logs begin at Mon 2022-08-08 13:48:09 UTC, end at Mon 2022-08-08 14:46:28 UTC. -- Aug 08 14:22:34.921583 dv-cinder-852009-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 14:22:34.933513 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 14:22:34.935613 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 14:22:34 2022] *** Aug 08 14:22:34.935613 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 14:22:34.935613 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 14:22:34.935613 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: nodename: dv-cinder-852009-2-iscsi Aug 08 14:22:34.935613 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: machine: x86_64 Aug 08 14:22:34.935613 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: clock source: unix Aug 08 14:22:34.935613 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: pcre jit disabled Aug 08 14:22:34.935613 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: detected number of CPU cores: 4 Aug 08 14:22:34.935613 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: current working directory: / Aug 08 14:22:34.935613 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: detected binary path: /usr/bin/uwsgi-core Aug 08 14:22:34.935613 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: your processes number limit is 47680 Aug 08 14:22:34.935613 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: your memory page size is 4096 bytes Aug 08 14:22:34.935613 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: detected max file descriptor number: 2048 Aug 08 14:22:34.935613 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: lock engine: pthread robust mutexes Aug 08 14:22:34.936540 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: thunder lock: enabled Aug 08 14:22:34.936540 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 14:22:34.936540 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 14:22:34.975881 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: Python main interpreter initialized at 0x5627f6c699c0 Aug 08 14:22:34.975881 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: python threads support enabled Aug 08 14:22:34.975881 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: your server socket listen backlog is limited to 100 connections Aug 08 14:22:34.975881 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: your mercy for graceful operations on workers is 90 seconds Aug 08 14:22:34.976300 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 14:22:34.976300 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: *** Operational MODE: preforking *** Aug 08 14:22:34.976601 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: *** uWSGI is running in multiple interpreter mode *** Aug 08 14:22:34.976601 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: spawned uWSGI master process (pid: 103103) Aug 08 14:22:34.976813 dv-cinder-852009-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 14:22:34.977815 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: spawned uWSGI worker 1 (pid: 103104, cores: 1) Aug 08 14:22:34.977815 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: spawned uWSGI worker 2 (pid: 103105, cores: 1) Aug 08 14:22:34.978105 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 14:22:35.651547 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 14:22:35.689347 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 14:22:36.735067 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 14:22:36.735067 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: from cryptography.utils import int_from_bytes Aug 08 14:22:36.736274 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 14:22:36.736274 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: from cryptography.utils import int_from_bytes Aug 08 14:22:36.752296 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 14:22:36.752296 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: from cryptography.utils import int_from_bytes Aug 08 14:22:36.752874 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 14:22:36.752874 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: from cryptography.utils import int_from_bytes Aug 08 14:22:39.252085 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 14:22:39.252904 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 14:22:39.252904 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 14:22:39.253176 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 14:22:39.253327 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 14:22:39.253732 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.254059 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.254384 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.254699 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.255031 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.255374 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.255696 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.256015 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.256341 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.256601 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.256942 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.257241 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-2-iscsi {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.257564 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.257870 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.258176 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.258497 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.258798 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.259161 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.259451 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.259957 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.260391 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.260698 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.261007 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.261343 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.261651 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.262014 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.262406 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.262699 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.263049 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.263384 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.263718 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-2-iscsi {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.264091 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.264366 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.264666 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.264978 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.265295 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.265613 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.265996 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.266282 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.267598 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.267598 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.268222 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 14:22:39.269277 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.269535 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 14:22:39.269961 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.269961 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.270345 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 14:22:39.270549 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.270549 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.270940 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 14:22:39.271366 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.271572 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 14:22:39.271778 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.271992 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.272212 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.272212 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.272583 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.272782 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.272982 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.273204 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.273403 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.273577 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.273735 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.273980 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.273980 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.274296 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.274461 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.274628 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.274786 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.274970 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.275180 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.275350 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.275530 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.275706 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.275891 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.276074 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.276242 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.276424 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-2-iscsi {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.276606 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.276606 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.276919 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.277089 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.277244 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.277397 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.277563 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.277718 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.277896 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.278063 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.278313 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.278498 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.278679 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.278849 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.279033 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.279246 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.279246 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.279645 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.279918 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.280277 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.280277 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.280656 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.280656 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.281039 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.281256 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.281643 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.281848 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.282105 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.282313 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.282536 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.282729 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.282930 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.283617 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.283748 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.283883 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.284063 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.284237 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.284404 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.284562 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.284728 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-2-iscsi {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.284885 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.285086 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.285242 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.285409 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.285590 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.285590 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.285905 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.286072 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.286238 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.286418 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.286597 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.286831 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.286831 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.287174 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.287339 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.287502 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.287671 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.287843 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.288014 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.288170 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.288414 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.288589 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.288797 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.288981 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.289151 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.289331 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.289331 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.289724 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.289869 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.289992 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.290114 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.290114 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.290485 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.290627 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.290627 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.290861 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.290990 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.291168 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.291309 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.291309 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.291567 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.291806 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.291932 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.292063 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.292063 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.292305 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.292429 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.292429 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.292663 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.292799 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.292948 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.293180 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.293180 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.293417 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.293548 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.293548 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.293787 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.293958 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.294125 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.294288 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.294288 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.294599 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.294765 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.294765 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.295070 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.295342 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.295521 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.295690 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.295690 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.296022 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.296189 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.296189 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.296495 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.296684 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.296898 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.297063 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.297063 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.297365 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.297531 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.297703 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.297866 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.297866 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.298162 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.298333 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.298333 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.298833 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.299009 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.299243 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.299429 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.299429 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.299791 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.299927 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.299927 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.300416 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.300668 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.300794 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.300925 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.300925 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.301167 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.301289 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.301416 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.301546 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.301546 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.301816 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.302058 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.302058 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.302295 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.302417 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.302550 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.302681 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.302681 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.302917 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.303038 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.303194 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.303328 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.303547 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.303672 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.303903 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.304153 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.304318 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.304588 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.304746 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.304957 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.305216 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.305396 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.305716 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.305894 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.306088 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.306287 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.306460 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.306824 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.307003 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.307302 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.307462 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.307635 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.307916 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.308093 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.308277 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.308599 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.308798 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.308962 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.309204 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.309427 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.309567 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.309790 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.309919 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.310273 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.310400 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.310756 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.310935 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.311064 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.311333 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.311511 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.311662 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.312147 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.312284 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.312408 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.312607 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.312737 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.312974 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.313143 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.313322 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.313635 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.313770 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.314007 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.314254 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.314392 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.314667 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.314839 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.314999 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.315394 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.315535 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.315757 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.316035 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.316164 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.316514 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.316640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.316884 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:22:39.317146 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.317312 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.317654 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.317788 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.318046 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.318258 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.318386 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.318740 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.318872 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.319178 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.319428 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.319582 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.319814 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.319950 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.320138 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.320461 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.320590 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.320776 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.321042 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.321172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.321396 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.321605 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.321794 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.322123 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.322432 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.322582 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.322708 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.322831 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.323072 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.323252 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.323420 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.323736 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.323861 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.324062 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.324231 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.324393 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.324719 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.324844 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.325102 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.325317 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.325507 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.325857 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.325982 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.326228 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.326364 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.326617 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.326832 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.327009 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.327391 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.327519 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.327771 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.327899 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.328087 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.328386 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.328514 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.328792 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.329506 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.329628 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.329924 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.330049 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.330296 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.330595 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.330731 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.331174 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.331312 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.331450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.331670 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.331798 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.332069 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.332262 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.332405 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.332741 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.332871 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.333062 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.333353 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.333496 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.333827 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.333953 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.334164 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.334457 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.334597 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.334886 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.335013 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.335293 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.335573 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.335700 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.335969 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.336120 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.336323 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.336651 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.336776 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.337049 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.337217 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.337352 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.337744 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.337870 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.338114 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.338352 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.338497 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.338894 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.339022 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.339176 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.339516 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.339644 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.339893 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.340062 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.340224 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.340569 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.340693 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.340901 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.341206 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.341398 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.341557 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.341767 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.341945 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.342284 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.342422 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.342677 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.342864 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.343032 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.343435 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.343578 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.343806 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.343996 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.344156 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.344557 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.345184 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.345408 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.345674 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.345803 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.346142 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.346268 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.346526 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.346803 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.346929 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.347271 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.347402 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.347613 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.347940 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.348069 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.348304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.348530 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.348659 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.349007 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.349207 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.349360 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.349633 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.349754 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.350018 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.350200 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.350341 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.350686 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.350816 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.351029 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.351367 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.351545 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.351748 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.351931 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.352092 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.352499 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.352647 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.352801 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.353112 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.353244 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.353497 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.353698 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.353894 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.354250 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.354389 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.354560 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.354844 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.354971 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.355308 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.355453 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.355689 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.356008 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.356143 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.356406 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.356641 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.356783 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.357079 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.357213 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.357397 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.357664 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.357799 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.358077 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.358203 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.358405 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.358634 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.358761 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.359117 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.359288 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.359463 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.359788 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.359920 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.360212 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.360378 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.360601 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.360945 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.361093 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.361326 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.361495 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.361745 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.362062 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.362224 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.362460 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.362671 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.362844 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.363257 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.363394 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.363580 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.363838 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.363964 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.364242 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.364407 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.364615 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.364976 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.365100 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.365361 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.365610 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.365746 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.366054 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.366180 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.366389 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.366718 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.366857 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.367031 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.367412 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.367541 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.367791 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.368007 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.368137 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.368498 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.368623 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.368838 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.369177 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.369321 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.369540 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.369666 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.369872 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.370201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.370322 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.370546 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.370722 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.370921 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.371252 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.371395 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.371627 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.371809 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.371993 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.372319 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.372453 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.372725 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.372870 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.373126 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.373371 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.373497 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.373815 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.373940 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.374132 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.374433 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.374568 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.374789 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.374976 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.375191 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.375569 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.375696 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.375966 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.376144 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.376300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.376688 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.376824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.377036 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.377309 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.377435 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.377726 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.377894 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.378113 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.378426 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.378558 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.378799 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.379028 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.379211 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.379579 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.379714 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.379935 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.380062 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.380260 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.380400 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.380656 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.380823 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.381045 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.381363 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.381487 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.381745 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.381877 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.382120 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.382253 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.382436 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.382572 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.382801 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.382941 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.383165 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.383450 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.383591 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.383876 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.384004 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.384196 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.384491 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.384619 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.384912 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.385085 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.385312 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.385634 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.385766 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.385996 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.386213 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.386354 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.386634 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.386812 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.386984 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.387393 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.387522 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.387978 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.388105 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.388408 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.388570 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.388789 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.389158 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.389299 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.389590 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.389723 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.389957 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.390283 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.390412 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.390754 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.390879 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.391186 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.391975 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.392119 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.392385 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.392525 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.392761 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.393101 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.393238 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.393596 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.393735 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.393869 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.394172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.394300 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.394573 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.394804 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.394930 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.395299 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.395430 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.395674 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.395831 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.395997 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.396339 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.396480 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.396698 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.396902 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.397077 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.397444 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.397581 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.397820 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.397984 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.398208 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.398510 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.398637 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.398932 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.399066 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.399270 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.399530 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.399662 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.400069 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.400205 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.400442 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.400607 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.400789 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.401157 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.401299 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.401563 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.401726 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.401914 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.402225 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.402351 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.402613 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.402816 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.402944 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.403332 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.403468 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.403691 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.403915 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.404077 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.404455 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.404583 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.404811 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.405032 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.405249 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.405562 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.405687 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.405914 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.406168 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.406310 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.406606 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.406764 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.407034 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.408221 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.408365 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.408365 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.408621 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.408745 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.409040 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.409165 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.409421 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.409609 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.409783 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.410099 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.410224 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.410470 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.410717 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.410856 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.411167 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.411312 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.411541 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.411746 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.411881 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.412150 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.412276 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.412475 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.412812 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.412937 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.413218 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.413467 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.413594 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.413906 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.414051 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.414325 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.414462 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.414692 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.414963 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.415105 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.415398 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.415525 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.415706 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.415996 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.416124 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.416362 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.416488 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.416744 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.416966 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.417125 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.417437 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.417804 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.417929 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.418160 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.418412 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.418547 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.418831 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.418989 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.419217 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.419529 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.419708 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.419834 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.420142 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.420277 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.420480 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.420709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.420834 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.421107 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.421300 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.421436 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.421715 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.421891 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.422027 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.422317 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.422498 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.422698 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.423002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.423154 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.423437 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.423680 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.423816 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.424047 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.424208 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.424381 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.424794 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.424974 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.425355 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.425504 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.425656 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.425815 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.425947 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.426130 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.426444 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.426570 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.426758 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.426959 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.427152 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.427380 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.427508 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.427706 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.427997 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.428133 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.428317 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.428519 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.428647 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.428949 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.429082 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.429274 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.429536 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.429747 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.429877 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.430050 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.430188 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.430467 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.430593 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.430774 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.431122 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.431265 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.431532 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.431659 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.431869 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.432183 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.432315 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.432498 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.432819 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.432946 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.433171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.433389 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.433516 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.433857 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.434002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.434174 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.434516 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.434688 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.434903 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.435193 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.435341 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.435603 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.435755 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.435951 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.436267 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.436418 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.436625 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.436951 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.437099 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.437373 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.437551 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.437704 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.437978 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.438110 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.438322 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.438634 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.438797 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.438946 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.439278 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.439436 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.439586 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.439830 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.439999 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.440292 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.440431 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.440607 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.440925 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.441065 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.441303 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.441476 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.441635 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.441816 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.442045 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.442193 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.442434 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.442602 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.442755 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.443032 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.443224 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.443374 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.443669 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.443812 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.444047 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.444253 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.444507 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.444758 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.444894 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.445146 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.445277 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.445618 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.445765 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.445946 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.446193 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.446333 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.446604 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.446748 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.446949 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.447340 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.447478 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.447707 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.447895 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.448031 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.448376 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.448509 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.448746 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.449017 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.449150 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.449431 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.449572 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.449756 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.449944 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.450151 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.450381 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.450521 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.450796 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.451017 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.451211 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.451354 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.451525 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.451672 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.451994 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.452143 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.452369 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.452514 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.452734 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.452925 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.453073 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.453422 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.453599 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.453776 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.454569 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.454839 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.454993 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.455197 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.455346 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.455599 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.455747 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.456052 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.456198 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.456456 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.456616 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.456785 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.456986 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.457142 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.457427 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.457572 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.457734 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.457880 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.458032 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.458358 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.458505 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.458650 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.458859 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.459025 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.459270 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.459419 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.459586 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.459733 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.460028 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.460180 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.460329 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.460468 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.460702 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.460852 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.461006 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.461144 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.461327 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.461529 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.461678 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.461816 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.461954 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.462189 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.462360 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.462509 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.462735 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.462883 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.463207 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.463386 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.463541 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.463846 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.463994 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.464188 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.464459 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.464743 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.465013 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.465158 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.465345 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.465536 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.465682 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.465882 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.466098 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.466299 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.466479 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.466618 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.466765 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.467145 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.467300 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.467440 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.467754 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.467912 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.468061 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.468395 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.468540 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.468687 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.468974 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.469121 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.469304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.470189 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.470344 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.470543 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.470771 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.470907 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.471215 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.471360 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.471544 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.471918 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.472077 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.472252 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.472481 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.472639 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.472957 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.473103 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.473287 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.473579 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.473726 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.473970 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.474116 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.474352 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.474665 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.474953 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.475246 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.475405 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.475546 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.475747 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.475892 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.476063 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.476334 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.476489 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.476742 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.476887 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.477067 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.477451 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.477678 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.477987 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.478135 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.478376 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.478547 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.478736 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.479053 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.479230 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.479450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.479706 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.479801 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.480141 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.480251 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.480458 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.480788 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.480881 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.481133 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.481327 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.481521 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.481848 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.481956 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.482233 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.482446 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.482603 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.482964 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.483174 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.483322 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.483574 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.483732 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.484000 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.484170 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.484407 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.484651 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.484803 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.485218 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.485385 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.485534 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.485794 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.485955 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.486099 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.486337 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.486512 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.486771 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.487200 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.487364 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.487638 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.487802 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.487947 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.488097 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.488251 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.488529 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.488673 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.488878 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.489091 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.489285 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.489627 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.489777 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.490160 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.490735 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.491222 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.491376 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.491550 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.491921 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.492097 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.492239 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.492593 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.492851 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.493138 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.493294 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.493555 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.493709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.493951 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.494226 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.494384 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.494661 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.494869 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.495011 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.495381 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.495542 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.495695 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.495931 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.496089 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.496357 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.496501 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.496720 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.497028 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.497180 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.497406 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.497725 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.497833 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.498030 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.498272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.498398 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.498812 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.498916 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.499415 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.499521 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.499832 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.499946 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.500169 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.500490 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.500599 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.500898 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.501075 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.501530 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.501688 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.501850 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.502212 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.502373 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.502582 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.502743 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.502958 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.503291 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.503467 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.503726 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.503889 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.504096 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.504373 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.504530 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.504781 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.505096 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.505347 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.505594 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.505737 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.505874 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.506122 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.506288 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.506461 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.506837 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.506978 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.507179 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.507495 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.507650 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.507879 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.508029 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.508200 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.508530 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.508680 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.508864 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.509120 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.509263 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.509534 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.509685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.509847 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.510225 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.510369 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.510569 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.510794 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.510938 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.511218 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.511380 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.511573 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.511912 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.512062 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.512256 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.512474 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.512628 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.513001 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.513145 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.513385 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.513572 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.513726 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.514016 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.514158 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.514332 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.514654 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.514796 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.515013 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.515286 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.515443 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.515838 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.516000 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.516232 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.516905 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.517082 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.517425 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.517648 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.517803 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.518052 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.518232 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.518381 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.518652 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.518805 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.518977 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.519315 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.519462 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.519628 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.519938 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.520081 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.520249 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.520461 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.520648 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.520854 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.520997 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.521163 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.521472 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.521615 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.521778 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.522087 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.522232 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.522376 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.522623 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.522778 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.522976 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.523223 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.523370 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.523609 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.523770 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.523951 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.524273 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.524425 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.524590 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.524859 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.525003 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.525214 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.525401 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.525546 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.525831 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.525981 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.526134 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.526441 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.526567 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.526748 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.526995 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.527188 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.527401 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.527559 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.527705 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.528121 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.528237 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.528439 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.528697 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.528793 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.529073 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.529289 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.529492 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.529684 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.529857 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.530074 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.530396 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.530524 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.530732 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.530958 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.531055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.531440 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.531557 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.531791 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.532621 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.532837 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.533094 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.533350 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.533554 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.533731 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.533873 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.534020 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.534281 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.534427 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.534693 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.534845 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.535078 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.535399 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.535544 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.535745 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.535986 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.536117 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.536372 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.536588 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.536723 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.536950 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.537089 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.537257 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.537571 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.537728 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.537869 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.538181 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.538349 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.538511 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.538753 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.538917 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.539056 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.539353 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.539519 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.539665 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.539931 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.540082 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.540254 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.540474 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.540638 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.540840 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.540995 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.541156 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.541463 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.541612 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.541800 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.542055 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.542214 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.542424 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.542573 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.542725 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.543045 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.543219 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.543386 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.543702 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.543865 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.544020 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.544253 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.544404 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.544627 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.544786 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.544961 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.545279 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.545428 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.545593 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.545870 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.546029 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.546309 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.546467 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.546662 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.546947 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.547135 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.547357 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.547525 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.547774 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.548090 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.548272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.548484 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.548636 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.548794 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.549167 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.549325 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.549557 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.549794 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.549959 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.550485 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.550647 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.550794 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.551134 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.551294 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.551497 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.551686 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.551849 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.552176 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.552338 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.552525 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.552791 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.552957 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.553219 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.553388 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.553601 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.553913 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.554167 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.554316 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.554496 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.554658 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.554963 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.555147 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.555328 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.555635 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.555798 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.556087 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.556236 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.556523 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.556710 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.556862 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.557150 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.557309 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.557465 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.557829 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.557987 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.558148 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.558537 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 14:22:39.558706 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.559407 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.559997 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.561109 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.561675 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.562224 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.562773 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.563507 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.563964 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.564541 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.565103 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.565652 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.566230 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.566788 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.567399 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.568008 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.568599 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.569152 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.569707 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.570269 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.570907 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.572459 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.572934 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.573508 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.574076 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.574631 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.575229 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.575793 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.576365 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.576937 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.577507 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.578065 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.578612 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.579711 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.580300 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.580904 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.581483 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.582072 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.582638 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.583217 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.584223 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.584801 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.585395 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.585968 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.586542 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.587160 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.587680 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.588257 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.588827 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.589371 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.589910 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.590500 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.591041 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.591641 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.592188 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.592719 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.593312 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.593872 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.595481 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.596079 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.596639 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.597252 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.597827 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.598382 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.598922 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.599537 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.600113 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.600669 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.601219 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.601765 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.602300 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.603294 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.603880 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.604436 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.604975 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.605558 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.606098 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.606722 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.607297 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.607871 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.608415 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.608973 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.609554 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.610118 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.610664 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.611243 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.611807 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.612378 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.612939 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.613468 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.614053 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.614612 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.615188 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.615732 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.616315 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.616891 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.617502 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.618068 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.618614 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.619236 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.619819 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.620385 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.621016 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.621587 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.623029 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.623663 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.624237 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.624836 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.625426 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.626531 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.627129 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.627683 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.628283 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.628839 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.629377 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.630144 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.630690 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.631305 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.631853 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.632406 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.632985 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.633529 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.634127 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.634643 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.635235 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.635798 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.636358 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.636928 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.637564 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.638136 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.638706 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.639308 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.639941 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.640451 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.641002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.642111 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.642664 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.643284 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.643904 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.644480 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.645031 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.645788 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.646349 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.646922 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.647557 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.648125 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.648706 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.649270 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.649823 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.650436 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.650990 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.651636 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.652228 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.652808 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.653379 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.653972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.654511 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.655048 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.655657 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.656227 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.656804 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.657385 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.657915 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.658473 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.659039 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.659630 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.660178 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.660712 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.661268 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.661797 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.662354 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.662917 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.663509 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.664044 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.664570 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.665123 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.665672 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.666232 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.666769 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.667329 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.667869 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.668469 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.669071 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.669654 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.670248 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.670810 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.671450 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.671995 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.672557 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.673174 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.673758 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.674299 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.674890 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.675733 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.676304 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.676872 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.677427 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.677962 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.678507 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.679141 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.679839 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.680368 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.680972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.681555 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.682146 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.682703 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.683317 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.683935 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.684494 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.685042 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.685589 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.686162 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.686739 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.687348 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.687912 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.688991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.689551 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.690150 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.690742 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.691367 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.691927 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.692526 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.693102 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.693806 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.694302 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.694927 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.695541 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.696093 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.696648 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.697191 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:22:39.697645 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 14:22:39.722313 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO dbcounter [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Registered counter for database nova_api Aug 08 14:22:39.743245 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_db.sqlalchemy.engines [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:22:39.751249 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG dbcounter [-] [103104] Writer thread running {{(pid=103104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:22:39.817632 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.context [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dbc50433-daea-4bbf-a66d-720f9de1a6a6(cell1) {{(pid=103104) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 14:22:39.821755 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:22:39.822247 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:22:39.824045 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:22:39.824752 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:22:39.825216 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:22:39.827398 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:22:39.830176 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO dbcounter [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Registered counter for database nova_cell0 Aug 08 14:22:39.836464 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO dbcounter [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Registered counter for database nova_cell1 Aug 08 14:22:39.847246 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_db.sqlalchemy.engines [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:22:39.848502 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_db.sqlalchemy.engines [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:22:39.859486 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG dbcounter [-] [103104] Writer thread running {{(pid=103104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:22:39.859486 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG dbcounter [-] [103104] Writer thread running {{(pid=103104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:22:39.949783 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO dbcounter [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] Registered counter for database nova_api Aug 08 14:22:39.982940 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG oslo_db.sqlalchemy.engines [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:22:39.990458 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG dbcounter [-] [103105] Writer thread running {{(pid=103105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:22:40.019806 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO dbcounter [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Registered counter for database nova_cell0 Aug 08 14:22:40.027686 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_db.sqlalchemy.engines [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:22:40.033000 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG dbcounter [-] [103104] Writer thread running {{(pid=103104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:22:40.048577 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.context [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dbc50433-daea-4bbf-a66d-720f9de1a6a6(cell1) {{(pid=103105) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 14:22:40.052894 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG oslo_concurrency.lockutils [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:22:40.053357 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG oslo_concurrency.lockutils [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:22:40.054971 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG oslo_concurrency.lockutils [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:22:40.055767 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG oslo_concurrency.lockutils [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:22:40.056219 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG oslo_concurrency.lockutils [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:22:40.058299 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG oslo_concurrency.lockutils [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:22:40.060430 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO dbcounter [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] Registered counter for database nova_cell0 Aug 08 14:22:40.066452 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO dbcounter [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] Registered counter for database nova_cell1 Aug 08 14:22:40.076209 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG oslo_db.sqlalchemy.engines [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:22:40.080025 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG oslo_db.sqlalchemy.engines [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:22:40.084669 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG dbcounter [-] [103105] Writer thread running {{(pid=103105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:22:40.090328 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG dbcounter [-] [103105] Writer thread running {{(pid=103105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:22:40.236159 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO dbcounter [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] Registered counter for database nova_cell0 Aug 08 14:22:40.248999 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG oslo_db.sqlalchemy.engines [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:22:40.253818 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG dbcounter [-] [103105] Writer thread running {{(pid=103105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:22:40.385674 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: WARNING keystonemiddleware.auth_token [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 14:22:40.393938 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: WARNING keystonemiddleware.auth_token [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 14:22:40.574936 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: WARNING keystonemiddleware.auth_token [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 14:22:40.582900 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: WARNING keystonemiddleware.auth_token [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 14:22:40.740849 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: WARNING keystonemiddleware.auth_token [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 14:22:40.746780 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: WARNING keystonemiddleware.auth_token [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 14:22:40.752614 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5627f6c699c0 pid: 103104 (default app) Aug 08 14:22:40.754677 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:22:40.755890 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Aug 08 14:22:40.756285 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Mon Aug 8 14:22:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:22:40.937983 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: WARNING keystonemiddleware.auth_token [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 14:22:40.944585 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: WARNING keystonemiddleware.auth_token [None req-96ac0dfc-9a1d-4767-b853-2b00161bebd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 14:22:40.949832 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5627f6c699c0 pid: 103105 (default app) Aug 08 14:23:56.741565 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:23:56.742555 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 08 14:23:56.743203 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 14:23:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:23:56.756262 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG dbcounter [-] [103105] Writing DB stats nova_api:SELECT=3 {{(pid=103105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:23:56.757366 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG dbcounter [-] [103105] Writing DB stats nova_cell0:SELECT=3 {{(pid=103105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:23:56.758096 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG dbcounter [-] [103105] Writing DB stats nova_cell1:SELECT=3 {{(pid=103105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:23:56.758991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG dbcounter [-] [103105] Writing DB stats nova_cell0:SELECT=3 {{(pid=103105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:23:57.636172 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-3159f13c-d83e-4796-a25e-bd0a122864ef admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:23:57.671984 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-3159f13c-d83e-4796-a25e-bd0a122864ef admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.921192 Aug 08 14:23:57.673011 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 1/3] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Aug 8 14:23:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:23:59.903699 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:23:59.904773 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-ebdcd523-f7a0-4ef8-a3d5-b002918c1939 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002021 Aug 08 14:23:59.910016 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 3/4] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 14:23:59 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:00.384206 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-6884f8dd-53d2-4be5-bc91-133eefc3e4e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "cirros256", "id": "c1", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:00.405037 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 14:24:00.405037 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: warnings.warn(msg) Aug 08 14:24:00.436567 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-6884f8dd-53d2-4be5-bc91-133eefc3e4e5 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.525117 Aug 08 14:24:00.437151 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 2/5] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 14:23:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:24:00.665759 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-497107b8-2b39-4a76-a804-36594f4bf44e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:00.670068 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 14:24:00.670068 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: warnings.warn(msg) Aug 08 14:24:00.673097 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG dbcounter [-] [103104] Writing DB stats nova_api:SELECT=3 {{(pid=103104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:24:00.673901 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG dbcounter [-] [103104] Writing DB stats nova_cell1:SELECT=3 {{(pid=103104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:24:00.674847 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG dbcounter [-] [103104] Writing DB stats nova_cell0:SELECT=3 {{(pid=103104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:24:00.675564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG dbcounter [-] [103104] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:24:00.747151 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-497107b8-2b39-4a76-a804-36594f4bf44e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298309 Aug 08 14:24:00.753076 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 4/6] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Aug 8 14:24:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:24:03.010692 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-6884f8dd-53d2-4be5-bc91-133eefc3e4e5 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:03.012079 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-6884f8dd-53d2-4be5-bc91-133eefc3e4e5 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001883 Aug 08 14:24:03.013292 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 3/7] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 14:24:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:03.722960 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-f0c7ea2e-6202-446a-b223-a938f9c703c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "disk": 5, "id": "d1"}} {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:03.742066 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 14:24:03.742066 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: warnings.warn(msg) Aug 08 14:24:03.761979 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-f0c7ea2e-6202-446a-b223-a938f9c703c2 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.742283 Aug 08 14:24:03.762943 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 5/8] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 14:24:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:24:03.776525 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-4c1d5b1c-a376-48b2-88a0-fa634627180a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:03.781065 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 14:24:03.781065 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: warnings.warn(msg) Aug 08 14:24:03.822247 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-4c1d5b1c-a376-48b2-88a0-fa634627180a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050216 Aug 08 14:24:03.835118 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 4/9] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Aug 8 14:24:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:24:06.066735 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-f0c7ea2e-6202-446a-b223-a938f9c703c2 admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:06.068009 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-f0c7ea2e-6202-446a-b223-a938f9c703c2 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Aug 08 14:24:06.068492 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 14:24:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:06.471330 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-ac69ad22-43fc-492a-9793-3b776f41dbe1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "swap": 0}} {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:06.490994 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-ac69ad22-43fc-492a-9793-3b776f41dbe1 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.416411 Aug 08 14:24:06.491513 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 5/11] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 14:24:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:24:06.504185 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-889fd19f-a8b1-4e41-a0e4-f6f7671d94ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:06.527899 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-889fd19f-a8b1-4e41-a0e4-f6f7671d94ba admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027423 Aug 08 14:24:06.528460 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 7/12] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Aug 8 14:24:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:24:08.756326 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-ac69ad22-43fc-492a-9793-3b776f41dbe1 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:08.757276 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-ac69ad22-43fc-492a-9793-3b776f41dbe1 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 08 14:24:08.757826 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 6/13] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 14:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:09.195787 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-fe166b32-48d5-4675-90d2-556fd5e958ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "ram": 2048, "vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:09.221569 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-fe166b32-48d5-4675-90d2-556fd5e958ae admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457946 Aug 08 14:24:09.222789 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 8/14] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 14:24:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 14:24:09.243264 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-8531f0dd-c2a1-49de-a076-6339a96ea72a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:09.271979 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-8531f0dd-c2a1-49de-a076-6339a96ea72a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032351 Aug 08 14:24:09.272738 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 7/15] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Aug 8 14:24:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:24:11.476815 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-fe166b32-48d5-4675-90d2-556fd5e958ae admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:11.478645 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-fe166b32-48d5-4675-90d2-556fd5e958ae admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002189 Aug 08 14:24:11.479014 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 9/16] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 14:24:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:11.908137 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-a5406d03-6193-4afd-a32d-608c332458b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "id": "d4", "ram": 4096, "name": "ds4G", "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:11.927773 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-a5406d03-6193-4afd-a32d-608c332458b1 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441647 Aug 08 14:24:11.928318 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 8/17] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 14:24:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 14:24:11.940399 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-956cea4b-4b29-44f5-a196-32f1df609ffe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:11.971567 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-956cea4b-4b29-44f5-a196-32f1df609ffe admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034158 Aug 08 14:24:11.973166 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 10/18] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Aug 8 14:24:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:24:14.348627 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-a5406d03-6193-4afd-a32d-608c332458b1 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:14.349645 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-a5406d03-6193-4afd-a32d-608c332458b1 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 08 14:24:14.350141 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 9/19] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 14:24:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:14.866250 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-80f536c4-8c16-4f1e-8615-6c7d2c124fa2 admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:14.892548 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-80f536c4-8c16-4f1e-8615-6c7d2c124fa2 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.535170 Aug 08 14:24:14.893109 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 11/20] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Aug 8 14:24:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:24:17.164122 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-a5406d03-6193-4afd-a32d-608c332458b1 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:17.165253 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-a5406d03-6193-4afd-a32d-608c332458b1 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Aug 08 14:24:17.165674 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 10/21] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 14:24:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:17.666363 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-c08009e5-5ec1-42d5-b070-05ec1715f31c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1}} {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:17.687603 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-c08009e5-5ec1-42d5-b070-05ec1715f31c admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.515535 Aug 08 14:24:17.688187 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 12/22] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 14:24:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:24:17.701458 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-f4c2c41c-8a38-41c3-81bb-68163609f145 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:17.730057 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-f4c2c41c-8a38-41c3-81bb-68163609f145 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032585 Aug 08 14:24:17.731065 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 11/23] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Aug 8 14:24:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:24:20.093171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-c08009e5-5ec1-42d5-b070-05ec1715f31c admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:20.094173 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-c08009e5-5ec1-42d5-b070-05ec1715f31c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 08 14:24:20.094722 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 14:24:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:20.488971 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-c04b3077-bc3d-4e16-9c5a-eee9ec9879a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "ram": 2048, "id": "2", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:20.507662 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-c04b3077-bc3d-4e16-9c5a-eee9ec9879a0 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.407323 Aug 08 14:24:20.508213 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 12/25] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 14:24:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 14:24:20.520733 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-e5166b3c-39d2-479d-864c-b902d58e534b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:20.545595 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-e5166b3c-39d2-479d-864c-b902d58e534b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028545 Aug 08 14:24:20.546170 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 14/26] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Aug 8 14:24:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:24:22.766890 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-c04b3077-bc3d-4e16-9c5a-eee9ec9879a0 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:22.767926 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-c04b3077-bc3d-4e16-9c5a-eee9ec9879a0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 08 14:24:22.768327 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 13/27] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 14:24:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:23.185546 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-235f5880-e410-4508-ba28-255d5aaca067 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "vcpus": 2}} {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:23.207840 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-235f5880-e410-4508-ba28-255d5aaca067 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.433202 Aug 08 14:24:23.208514 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 15/28] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 14:24:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 14:24:23.220977 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-7f7d4c26-a780-4aa5-b0b3-bddcef01157e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:23.245982 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-7f7d4c26-a780-4aa5-b0b3-bddcef01157e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028160 Aug 08 14:24:23.247000 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 14/29] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Aug 8 14:24:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:24:25.555939 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-235f5880-e410-4508-ba28-255d5aaca067 admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:25.556941 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-235f5880-e410-4508-ba28-255d5aaca067 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 08 14:24:25.557343 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 16/30] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 14:24:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:26.014584 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-d2c1e8ca-6b8a-4bcd-8398-4ce05d383f66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "swap": 0, "id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large"}} {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:26.034515 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-d2c1e8ca-6b8a-4bcd-8398-4ce05d383f66 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.471050 Aug 08 14:24:26.035440 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 15/31] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 14:24:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:24:26.049957 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-d1e06dc2-5712-4726-9c17-ab97fe5ebb5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:26.076723 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-d1e06dc2-5712-4726-9c17-ab97fe5ebb5f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033327 Aug 08 14:24:26.077292 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 17/32] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Aug 8 14:24:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:24:28.304143 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-d2c1e8ca-6b8a-4bcd-8398-4ce05d383f66 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:28.305150 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-d2c1e8ca-6b8a-4bcd-8398-4ce05d383f66 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 08 14:24:28.305551 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 16/33] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 14:24:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:28.829783 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-1686558d-1343-430b-809c-77e2f5252c7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:28.849575 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-1686558d-1343-430b-809c-77e2f5252c7b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.537796 Aug 08 14:24:28.850350 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 18/34] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 14:24:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:24:28.867846 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-02fcd6fb-3af7-4753-aead-b9cbd3915e7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:28.874673 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG dbcounter [-] [103105] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:24:28.900444 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-02fcd6fb-3af7-4753-aead-b9cbd3915e7d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038772 Aug 08 14:24:28.901048 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 17/35] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Aug 8 14:24:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:24:48.638411 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-1686558d-1343-430b-809c-77e2f5252c7b admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:48.640432 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-1686558d-1343-430b-809c-77e2f5252c7b admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002573 Aug 08 14:24:48.642129 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 19/36] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 14:24:48 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:24:48.657686 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG dbcounter [-] [103105] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:24:49.078473 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-42e714c1-1ec7-4df3-bc60-d7f81ea28c55 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:49.097222 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-42e714c1-1ec7-4df3-bc60-d7f81ea28c55 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.444409 Aug 08 14:24:49.097690 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 18/37] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Aug 8 14:24:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:24:50.233963 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-1686558d-1343-430b-809c-77e2f5252c7b admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:50.235790 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-1686558d-1343-430b-809c-77e2f5252c7b admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002551 Aug 08 14:24:50.236516 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 20/38] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 14:24:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:50.926981 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-6b94c4ce-f7f7-489c-846a-489e4c7c6e0e admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:50.932774 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.wsgi [None req-6b94c4ce-f7f7-489c-846a-489e4c7c6e0e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-6b94c4ce-f7f7-489c-846a-489e4c7c6e0e admin admin] Request method failure captured: Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Accept: application/json Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Accept-Encoding: gzip, deflate Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Connection: keep-alive Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Content-Length: 0 Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Host: 10.222.0.50 Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Openstack-Api-Version: compute 2.90 Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Openstack-System-Scope: None Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: User-Agent: python-novaclient Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Auth-Token: gAAAAABi8Ryyfpomj85MgaH-8m6oPmuT1vzAZ_MlROMxbfzdKbvkAEdJzSyPZnS0ZjlQywWu7ci9o1M8DLfXh76rTPNj3AEjY2KiceKzeKmRBQGLq_pV0dta6XP0CJpUkvqpD0RkM-bBc-R9ENBai3CBq8HwyRrZgxuFkpITqMsHn3KNLIg7twQ Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Domain-Id: None Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Domain-Name: None Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Identity-Status: Confirmed Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Is-Admin-Project: True Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Project-Domain-Id: default Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Project-Domain-Name: Default Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Project-Id: 20988f0d51544772b78672526cf109cb Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Project-Name: admin Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Role: member,reader,admin Aug 08 14:24:50.938201 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Roles: member,reader,admin Aug 08 14:24:50.939972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/20988f0d51544772b78672526cf109cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_20988f0d51544772b78672526cf109cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/20988f0d51544772b78672526cf109cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/20988f0d51544772b78672526cf109cb"}]}] Aug 08 14:24:50.939972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Tenant: admin Aug 08 14:24:50.939972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Tenant-Id: 20988f0d51544772b78672526cf109cb Aug 08 14:24:50.939972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Tenant-Name: admin Aug 08 14:24:50.939972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User: admin Aug 08 14:24:50.939972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User-Domain-Id: default Aug 08 14:24:50.939972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User-Domain-Name: Default Aug 08 14:24:50.939972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User-Id: a4f3ff67989b433e88e7bd1a0058bb7d Aug 08 14:24:50.939972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User-Name: admin Aug 08 14:24:50.939972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: method: > Aug 08 14:24:50.939972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: exception: Flavor 42 could not be found. Aug 08 14:24:50.939972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: action_args: {'id': '42'} Aug 08 14:24:50.939972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:24:50.939972 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:24:50.941033 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:50.942435 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-6b94c4ce-f7f7-489c-846a-489e4c7c6e0e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:24:50.943712 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-6b94c4ce-f7f7-489c-846a-489e4c7c6e0e admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.432263 Aug 08 14:24:50.943712 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 19/39] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Aug 8 14:24:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 14:24:50.947638 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-54dc4b34-f1ec-4090-8f3b-66d82ac2f877 admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:50.951762 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG dbcounter [-] [103104] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:24:50.971505 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-54dc4b34-f1ec-4090-8f3b-66d82ac2f877 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027355 Aug 08 14:24:50.972070 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 21/40] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Aug 8 14:24:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:24:50.982567 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-1ff202be-a9ee-46ab-a26c-b231706c43ca admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:51.006595 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-1ff202be-a9ee-46ab-a26c-b231706c43ca admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028215 Aug 08 14:24:51.007173 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 20/41] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Aug 8 14:24:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:24:51.017342 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-2ca2aba9-ffdf-42d0-b5cd-f8b7daab2eb9 admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:51.023542 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.wsgi [None req-2ca2aba9-ffdf-42d0-b5cd-f8b7daab2eb9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-2ca2aba9-ffdf-42d0-b5cd-f8b7daab2eb9 admin admin] Request method failure captured: Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Accept: application/json Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Accept-Encoding: gzip, deflate Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Connection: keep-alive Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Content-Length: 0 Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Host: 10.222.0.50 Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Openstack-Api-Version: compute 2.90 Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Openstack-System-Scope: None Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: User-Agent: python-novaclient Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Auth-Token: gAAAAABi8Ryyfpomj85MgaH-8m6oPmuT1vzAZ_MlROMxbfzdKbvkAEdJzSyPZnS0ZjlQywWu7ci9o1M8DLfXh76rTPNj3AEjY2KiceKzeKmRBQGLq_pV0dta6XP0CJpUkvqpD0RkM-bBc-R9ENBai3CBq8HwyRrZgxuFkpITqMsHn3KNLIg7twQ Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Domain-Id: None Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Domain-Name: None Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Identity-Status: Confirmed Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Is-Admin-Project: True Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Project-Domain-Id: default Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Project-Domain-Name: Default Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Project-Id: 20988f0d51544772b78672526cf109cb Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Project-Name: admin Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Role: member,reader,admin Aug 08 14:24:51.027377 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Roles: member,reader,admin Aug 08 14:24:51.029727 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/20988f0d51544772b78672526cf109cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_20988f0d51544772b78672526cf109cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/20988f0d51544772b78672526cf109cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/20988f0d51544772b78672526cf109cb"}]}] Aug 08 14:24:51.029727 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Tenant: admin Aug 08 14:24:51.029727 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Tenant-Id: 20988f0d51544772b78672526cf109cb Aug 08 14:24:51.029727 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Tenant-Name: admin Aug 08 14:24:51.029727 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User: admin Aug 08 14:24:51.029727 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User-Domain-Id: default Aug 08 14:24:51.029727 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User-Domain-Name: Default Aug 08 14:24:51.029727 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User-Id: a4f3ff67989b433e88e7bd1a0058bb7d Aug 08 14:24:51.029727 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User-Name: admin Aug 08 14:24:51.029727 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: method: > Aug 08 14:24:51.029727 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: exception: Flavor 42 could not be found. Aug 08 14:24:51.029727 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: action_args: {'id': '42'} Aug 08 14:24:51.029727 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:24:51.029727 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:24:51.030909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:51.032300 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-2ca2aba9-ffdf-42d0-b5cd-f8b7daab2eb9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:24:51.033514 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-2ca2aba9-ffdf-42d0-b5cd-f8b7daab2eb9 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015612 Aug 08 14:24:51.033514 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 22/42] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Aug 8 14:24:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 14:24:52.011323 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-1ff202be-a9ee-46ab-a26c-b231706c43ca admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:52.012397 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-1ff202be-a9ee-46ab-a26c-b231706c43ca admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Aug 08 14:24:52.012835 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 21/43] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 14:24:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:52.552367 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-15ce6a75-98b4-41e6-9165-adb1040fc82e admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:52.557992 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.wsgi [None req-15ce6a75-98b4-41e6-9165-adb1040fc82e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-15ce6a75-98b4-41e6-9165-adb1040fc82e admin admin] Request method failure captured: Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Accept: application/json Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Accept-Encoding: gzip, deflate Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Connection: keep-alive Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Content-Length: 0 Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Host: 10.222.0.50 Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Openstack-Api-Version: compute 2.90 Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Openstack-System-Scope: None Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: User-Agent: python-novaclient Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Auth-Token: gAAAAABi8RyzLLR0AMelohQzyBg0eWaoMNinB7h1aMz_sV6X7hKN5YeIZ5u03b_6qKU8xTqTz1vB1Dbva1vOxo76mhpLFnzl-aWhV0sp0uaByZUdEyTC6Ntd8V7Ss7AiC5IVRN_Q8dC_lLRvqoi_7fxKX003hbja0LqN8v-1juhGoDnZWWCl3ZQ Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Domain-Id: None Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Domain-Name: None Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Identity-Status: Confirmed Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Is-Admin-Project: True Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Project-Domain-Id: default Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Project-Domain-Name: Default Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Project-Id: 20988f0d51544772b78672526cf109cb Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Project-Name: admin Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Role: member,reader,admin Aug 08 14:24:52.559675 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Roles: member,reader,admin Aug 08 14:24:52.561172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/20988f0d51544772b78672526cf109cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_20988f0d51544772b78672526cf109cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/20988f0d51544772b78672526cf109cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/20988f0d51544772b78672526cf109cb"}]}] Aug 08 14:24:52.561172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Tenant: admin Aug 08 14:24:52.561172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Tenant-Id: 20988f0d51544772b78672526cf109cb Aug 08 14:24:52.561172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Tenant-Name: admin Aug 08 14:24:52.561172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User: admin Aug 08 14:24:52.561172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User-Domain-Id: default Aug 08 14:24:52.561172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User-Domain-Name: Default Aug 08 14:24:52.561172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User-Id: a4f3ff67989b433e88e7bd1a0058bb7d Aug 08 14:24:52.561172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User-Name: admin Aug 08 14:24:52.561172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: method: > Aug 08 14:24:52.561172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: exception: Flavor 84 could not be found. Aug 08 14:24:52.561172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: action_args: {'id': '84'} Aug 08 14:24:52.561172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:24:52.561172 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:24:52.562002 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:52.563055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-15ce6a75-98b4-41e6-9165-adb1040fc82e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:24:52.564243 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-15ce6a75-98b4-41e6-9165-adb1040fc82e admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.410148 Aug 08 14:24:52.564243 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 23/44] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Aug 8 14:24:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 14:24:52.571456 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-c2eb449b-9891-4259-9728-91e93341fa77 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:52.587320 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-c2eb449b-9891-4259-9728-91e93341fa77 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019801 Aug 08 14:24:52.587915 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 22/45] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Aug 8 14:24:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:24:52.598497 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-0a472cd1-a4b3-487e-be5f-1027c15c8661 admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:52.616656 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-0a472cd1-a4b3-487e-be5f-1027c15c8661 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021642 Aug 08 14:24:52.617234 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 24/46] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Aug 8 14:24:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:24:52.627193 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-a2be9223-c8da-4e6e-859d-dfdadaf8b83e admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:52.632750 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.wsgi [None req-a2be9223-c8da-4e6e-859d-dfdadaf8b83e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-a2be9223-c8da-4e6e-859d-dfdadaf8b83e admin admin] Request method failure captured: Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Accept: application/json Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Accept-Encoding: gzip, deflate Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Connection: keep-alive Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Content-Length: 0 Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Host: 10.222.0.50 Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Openstack-Api-Version: compute 2.90 Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Openstack-System-Scope: None Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: User-Agent: python-novaclient Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Auth-Token: gAAAAABi8RyzLLR0AMelohQzyBg0eWaoMNinB7h1aMz_sV6X7hKN5YeIZ5u03b_6qKU8xTqTz1vB1Dbva1vOxo76mhpLFnzl-aWhV0sp0uaByZUdEyTC6Ntd8V7Ss7AiC5IVRN_Q8dC_lLRvqoi_7fxKX003hbja0LqN8v-1juhGoDnZWWCl3ZQ Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Domain-Id: None Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Domain-Name: None Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Identity-Status: Confirmed Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Is-Admin-Project: True Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Project-Domain-Id: default Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Project-Domain-Name: Default Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Project-Id: 20988f0d51544772b78672526cf109cb Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Project-Name: admin Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Role: member,reader,admin Aug 08 14:24:52.634272 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Roles: member,reader,admin Aug 08 14:24:52.635824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/20988f0d51544772b78672526cf109cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_20988f0d51544772b78672526cf109cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/20988f0d51544772b78672526cf109cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/20988f0d51544772b78672526cf109cb"}]}] Aug 08 14:24:52.635824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Tenant: admin Aug 08 14:24:52.635824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Tenant-Id: 20988f0d51544772b78672526cf109cb Aug 08 14:24:52.635824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Tenant-Name: admin Aug 08 14:24:52.635824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User: admin Aug 08 14:24:52.635824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User-Domain-Id: default Aug 08 14:24:52.635824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User-Domain-Name: Default Aug 08 14:24:52.635824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User-Id: a4f3ff67989b433e88e7bd1a0058bb7d Aug 08 14:24:52.635824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User-Name: admin Aug 08 14:24:52.635824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: method: > Aug 08 14:24:52.635824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: exception: Flavor 84 could not be found. Aug 08 14:24:52.635824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: action_args: {'id': '84'} Aug 08 14:24:52.635824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:24:52.635824 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:24:52.636709 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:52.638133 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-a2be9223-c8da-4e6e-859d-dfdadaf8b83e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:24:52.639440 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-a2be9223-c8da-4e6e-859d-dfdadaf8b83e admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012320 Aug 08 14:24:52.639440 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 23/47] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Aug 8 14:24:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 14:24:53.778068 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-0a472cd1-a4b3-487e-be5f-1027c15c8661 admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:53.779112 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-0a472cd1-a4b3-487e-be5f-1027c15c8661 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 08 14:24:53.779522 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 25/48] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 14:24:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:54.317012 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-ba6e808e-47fa-42ed-96b8-5648c55f6397 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:54.323441 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.wsgi [None req-ba6e808e-47fa-42ed-96b8-5648c55f6397 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-ba6e808e-47fa-42ed-96b8-5648c55f6397 admin admin] Request method failure captured: Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Accept: application/json Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Accept-Encoding: gzip, deflate Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Connection: keep-alive Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Content-Length: 0 Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Host: 10.222.0.50 Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Openstack-Api-Version: compute 2.90 Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Openstack-System-Scope: None Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: User-Agent: python-novaclient Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Auth-Token: gAAAAABi8Ry1-qY2K8U4VoD7LBYolI3W2TWYdrcNVv-ACkGPiqNnXTCwYDSJ4iu5IMxi0s3N-Smq_GksBkfVxSFgTShlR-u7dqD_2gcrX5Dc3sifgE7rUq3p6f-424Ry7QRySnwW-6l7AeNsPG-YlKwFLqVGwHtbf4IAwo1Zf3ix_OBImGc3jNY Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Domain-Id: None Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Domain-Name: None Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Identity-Status: Confirmed Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Is-Admin-Project: True Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Project-Domain-Id: default Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Project-Domain-Name: Default Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Project-Id: 20988f0d51544772b78672526cf109cb Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Project-Name: admin Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Role: member,reader,admin Aug 08 14:24:54.325002 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Roles: member,reader,admin Aug 08 14:24:54.326640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/20988f0d51544772b78672526cf109cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_20988f0d51544772b78672526cf109cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/20988f0d51544772b78672526cf109cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/20988f0d51544772b78672526cf109cb"}]}] Aug 08 14:24:54.326640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Tenant: admin Aug 08 14:24:54.326640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Tenant-Id: 20988f0d51544772b78672526cf109cb Aug 08 14:24:54.326640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-Tenant-Name: admin Aug 08 14:24:54.326640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User: admin Aug 08 14:24:54.326640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User-Domain-Id: default Aug 08 14:24:54.326640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User-Domain-Name: Default Aug 08 14:24:54.326640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User-Id: a4f3ff67989b433e88e7bd1a0058bb7d Aug 08 14:24:54.326640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: X-User-Name: admin Aug 08 14:24:54.326640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: method: > Aug 08 14:24:54.326640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: exception: Flavor 451 could not be found. Aug 08 14:24:54.326640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: action_args: {'id': '451'} Aug 08 14:24:54.326640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:24:54.326640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:24:54.327685 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: ERROR nova.api.openstack.wsgi Aug 08 14:24:54.328991 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-ba6e808e-47fa-42ed-96b8-5648c55f6397 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:24:54.330250 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-ba6e808e-47fa-42ed-96b8-5648c55f6397 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.399469 Aug 08 14:24:54.330250 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 24/49] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Aug 8 14:24:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 14:24:54.336317 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-6a8a69e7-3224-430a-a442-efed7cfd2829 admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:54.352053 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-6a8a69e7-3224-430a-a442-efed7cfd2829 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019235 Aug 08 14:24:54.352619 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 26/50] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Aug 8 14:24:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:24:54.362554 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-37fc68fd-9acf-4ff6-b166-2c9792a4f303 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:54.378018 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-37fc68fd-9acf-4ff6-b166-2c9792a4f303 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019012 Aug 08 14:24:54.378586 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 25/51] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Aug 8 14:24:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:24:54.389108 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-14f98434-9516-4ba1-ab4a-b64c01a52619 admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:54.394594 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.wsgi [None req-14f98434-9516-4ba1-ab4a-b64c01a52619 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-14f98434-9516-4ba1-ab4a-b64c01a52619 admin admin] Request method failure captured: Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Accept: application/json Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Accept-Encoding: gzip, deflate Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Connection: keep-alive Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Content-Length: 0 Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Host: 10.222.0.50 Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Openstack-Api-Version: compute 2.90 Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Openstack-System-Scope: None Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: User-Agent: python-novaclient Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Auth-Token: gAAAAABi8Ry1-qY2K8U4VoD7LBYolI3W2TWYdrcNVv-ACkGPiqNnXTCwYDSJ4iu5IMxi0s3N-Smq_GksBkfVxSFgTShlR-u7dqD_2gcrX5Dc3sifgE7rUq3p6f-424Ry7QRySnwW-6l7AeNsPG-YlKwFLqVGwHtbf4IAwo1Zf3ix_OBImGc3jNY Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Domain-Id: None Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Domain-Name: None Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Identity-Status: Confirmed Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Is-Admin-Project: True Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Project-Domain-Id: default Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Project-Domain-Name: Default Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Project-Id: 20988f0d51544772b78672526cf109cb Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Project-Name: admin Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Role: member,reader,admin Aug 08 14:24:54.396171 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Roles: member,reader,admin Aug 08 14:24:54.397450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/20988f0d51544772b78672526cf109cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_20988f0d51544772b78672526cf109cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/20988f0d51544772b78672526cf109cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/20988f0d51544772b78672526cf109cb"}]}] Aug 08 14:24:54.397450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Tenant: admin Aug 08 14:24:54.397450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Tenant-Id: 20988f0d51544772b78672526cf109cb Aug 08 14:24:54.397450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-Tenant-Name: admin Aug 08 14:24:54.397450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User: admin Aug 08 14:24:54.397450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User-Domain-Id: default Aug 08 14:24:54.397450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User-Domain-Name: Default Aug 08 14:24:54.397450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User-Id: a4f3ff67989b433e88e7bd1a0058bb7d Aug 08 14:24:54.397450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: X-User-Name: admin Aug 08 14:24:54.397450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: method: > Aug 08 14:24:54.397450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: exception: Flavor 451 could not be found. Aug 08 14:24:54.397450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: action_args: {'id': '451'} Aug 08 14:24:54.397450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:24:54.397450 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:24:54.398304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: ERROR nova.api.openstack.wsgi Aug 08 14:24:54.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-14f98434-9516-4ba1-ab4a-b64c01a52619 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:24:54.400549 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-14f98434-9516-4ba1-ab4a-b64c01a52619 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012915 Aug 08 14:24:54.400549 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 27/52] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Aug 8 14:24:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 14:24:55.393414 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-37fc68fd-9acf-4ff6-b166-2c9792a4f303 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:55.394415 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-37fc68fd-9acf-4ff6-b166-2c9792a4f303 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 08 14:24:55.394828 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 26/53] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 14:24:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:55.950725 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-96141b3d-ccfd-442f-8926-975bda307268 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:55.970701 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-96141b3d-ccfd-442f-8926-975bda307268 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.438320 Aug 08 14:24:55.971289 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 28/54] 10.222.0.50 () {64 vars in 1235 bytes} [Mon Aug 8 14:24:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 14:24:56.969039 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-37fc68fd-9acf-4ff6-b166-2c9792a4f303 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:56.970046 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-37fc68fd-9acf-4ff6-b166-2c9792a4f303 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 08 14:24:56.970451 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 27/55] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 14:24:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:57.494504 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-632735eb-2697-4d95-b580-e40caf1d435d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:57.513304 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-632735eb-2697-4d95-b580-e40caf1d435d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.406832 Aug 08 14:24:57.513860 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 29/56] 10.222.0.50 () {64 vars in 1235 bytes} [Mon Aug 8 14:24:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:24:58.506640 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-37fc68fd-9acf-4ff6-b166-2c9792a4f303 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:24:58.507716 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-37fc68fd-9acf-4ff6-b166-2c9792a4f303 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 08 14:24:58.508114 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 28/57] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 14:24:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:24:59.082698 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-c9707ba3-b891-47e5-a728-00dd10c62dc3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:24:59.101751 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-c9707ba3-b891-47e5-a728-00dd10c62dc3 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.454614 Aug 08 14:24:59.102289 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 30/58] 10.222.0.50 () {64 vars in 1235 bytes} [Mon Aug 8 14:24:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:25:00.087134 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-37fc68fd-9acf-4ff6-b166-2c9792a4f303 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:25:00.088173 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-37fc68fd-9acf-4ff6-b166-2c9792a4f303 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 08 14:25:00.088571 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 29/59] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 14:25:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:25:00.658950 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-471a9578-b133-4033-a742-a9baa32c63fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:25:00.680373 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-471a9578-b133-4033-a742-a9baa32c63fe admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.419192 Aug 08 14:25:00.680960 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 31/60] 10.222.0.50 () {64 vars in 1235 bytes} [Mon Aug 8 14:25:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 14:25:01.682525 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-37fc68fd-9acf-4ff6-b166-2c9792a4f303 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:25:01.683562 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-37fc68fd-9acf-4ff6-b166-2c9792a4f303 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 08 14:25:01.683970 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 30/61] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 14:25:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:25:02.262073 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-d599280f-cd46-431e-aabc-32ea353060fc admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:25:02.293633 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-d599280f-cd46-431e-aabc-32ea353060fc admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.470432 Aug 08 14:25:02.294215 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 32/62] 10.222.0.50 () {60 vars in 1202 bytes} [Mon Aug 8 14:25:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:25:53.788117 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-37fc68fd-9acf-4ff6-b166-2c9792a4f303 admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:25:53.789126 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-37fc68fd-9acf-4ff6-b166-2c9792a4f303 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 08 14:25:53.789533 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 31/63] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 14:25:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:25:53.800897 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG dbcounter [-] [103104] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:25:54.189860 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-4ef3f3db-d908-42ae-b44b-7cefe36f3470 admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:25:54.215325 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-4ef3f3db-d908-42ae-b44b-7cefe36f3470 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.419081 Aug 08 14:25:54.215878 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 33/64] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Aug 8 14:25:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:25:54.240361 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-c31f29b7-bddd-4dcc-8456-2573cc77c40b admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:25:54.243856 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG dbcounter [-] [103105] Writing DB stats nova_api:SELECT=14 {{(pid=103105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:25:54.249357 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-c31f29b7-bddd-4dcc-8456-2573cc77c40b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012862 Aug 08 14:25:54.249904 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 32/65] 10.222.0.50 () {60 vars in 1283 bytes} [Mon Aug 8 14:25:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:25:54.262195 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-338f1534-62df-4bd0-aa87-29b1ddde44d5 admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:25:54.269825 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-338f1534-62df-4bd0-aa87-29b1ddde44d5 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011690 Aug 08 14:25:54.270338 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 34/66] 10.222.0.50 () {60 vars in 1286 bytes} [Mon Aug 8 14:25:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:25:54.282964 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-ed7ed85d-1fda-4f27-816c-a6ceab36ac0a admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:25:54.290626 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-ed7ed85d-1fda-4f27-816c-a6ceab36ac0a admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011997 Aug 08 14:25:54.291169 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 33/67] 10.222.0.50 () {60 vars in 1286 bytes} [Mon Aug 8 14:25:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:25:54.302757 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-dd189a93-8911-4abc-acbc-d12bbb2aa69d admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:25:54.310352 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-dd189a93-8911-4abc-acbc-d12bbb2aa69d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011141 Aug 08 14:25:54.310866 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 35/68] 10.222.0.50 () {60 vars in 1283 bytes} [Mon Aug 8 14:25:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:28:53.708918 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-ed7ed85d-1fda-4f27-816c-a6ceab36ac0a admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:28:53.709923 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-ed7ed85d-1fda-4f27-816c-a6ceab36ac0a admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 08 14:28:53.710317 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 34/69] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 14:28:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:28:53.853984 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG dbcounter [-] [103104] Writing DB stats nova_api:SELECT=6 {{(pid=103104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:28:54.012441 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-c2080ca4-2a57-4ba2-84a1-270723676837 admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:28:54.014823 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 14:28:54.014823 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: warnings.warn(msg) Aug 08 14:28:54.015984 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-c2080ca4-2a57-4ba2-84a1-270723676837 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:28:54.016458 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-c2080ca4-2a57-4ba2-84a1-270723676837 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:28:54.016909 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-c2080ca4-2a57-4ba2-84a1-270723676837 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:28:54.017618 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-c2080ca4-2a57-4ba2-84a1-270723676837 admin admin] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:28:54.018055 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-c2080ca4-2a57-4ba2-84a1-270723676837 admin admin] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:28:54.018470 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-c2080ca4-2a57-4ba2-84a1-270723676837 admin admin] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:28:54.053154 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-c2080ca4-2a57-4ba2-84a1-270723676837 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200568 Aug 08 14:28:54.053729 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 36/70] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Aug 8 14:28:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:28:54.885112 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-ed7ed85d-1fda-4f27-816c-a6ceab36ac0a admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:28:54.886117 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-ed7ed85d-1fda-4f27-816c-a6ceab36ac0a admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 08 14:28:54.886509 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 35/71] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 14:28:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:28:55.081852 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-cc881ad8-c0f2-43c3-bc5b-1025cfa4b736 admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:28:55.084193 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 14:28:55.084193 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: warnings.warn(msg) Aug 08 14:28:55.085387 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-cc881ad8-c0f2-43c3-bc5b-1025cfa4b736 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:28:55.085859 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-cc881ad8-c0f2-43c3-bc5b-1025cfa4b736 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:28:55.086288 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-cc881ad8-c0f2-43c3-bc5b-1025cfa4b736 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:28:55.087001 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-cc881ad8-c0f2-43c3-bc5b-1025cfa4b736 admin admin] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:28:55.087646 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-cc881ad8-c0f2-43c3-bc5b-1025cfa4b736 admin admin] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:28:55.088198 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-cc881ad8-c0f2-43c3-bc5b-1025cfa4b736 admin admin] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:28:55.110000 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-cc881ad8-c0f2-43c3-bc5b-1025cfa4b736 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082013 Aug 08 14:28:55.110538 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 37/72] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Aug 8 14:28:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:29:06.336892 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-ed7ed85d-1fda-4f27-816c-a6ceab36ac0a admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:29:06.337902 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-ed7ed85d-1fda-4f27-816c-a6ceab36ac0a admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 08 14:29:06.338299 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 36/73] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 14:29:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:29:06.483575 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG dbcounter [-] [103104] Writing DB stats nova_cell0:SELECT=4 {{(pid=103104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:29:06.484317 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG dbcounter [-] [103104] Writing DB stats nova_cell1:SELECT=4 {{(pid=103104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:29:06.484960 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG dbcounter [-] [103104] Writing DB stats nova_api:SELECT=8 {{(pid=103104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:29:06.534261 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-c56730b7-f1df-41a6-b230-e16c7b11d217 admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:29:06.536665 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 14:29:06.536665 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: warnings.warn(msg) Aug 08 14:29:06.537762 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-c56730b7-f1df-41a6-b230-e16c7b11d217 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:29:06.538235 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-c56730b7-f1df-41a6-b230-e16c7b11d217 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:29:06.538663 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-c56730b7-f1df-41a6-b230-e16c7b11d217 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:29:06.539406 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-c56730b7-f1df-41a6-b230-e16c7b11d217 admin admin] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:29:06.539852 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-c56730b7-f1df-41a6-b230-e16c7b11d217 admin admin] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:29:06.540270 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-c56730b7-f1df-41a6-b230-e16c7b11d217 admin admin] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:29:06.565615 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-c56730b7-f1df-41a6-b230-e16c7b11d217 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086487 Aug 08 14:29:06.566100 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 38/74] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Aug 8 14:29:06 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:29:07.398745 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: DEBUG nova.api.openstack.wsgi [None req-ed7ed85d-1fda-4f27-816c-a6ceab36ac0a admin admin] Calling method '>' {{(pid=103105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:29:07.399815 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: INFO nova.api.openstack.requestlog [None req-ed7ed85d-1fda-4f27-816c-a6ceab36ac0a admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 08 14:29:07.400207 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: [pid: 103105|app: 0|req: 37/75] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 14:29:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:29:07.592058 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG nova.api.openstack.wsgi [None req-79581b37-ab98-427e-bf84-4ce223e01bef admin admin] Calling method '>' {{(pid=103104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:29:07.594434 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 14:29:07.594434 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: warnings.warn(msg) Aug 08 14:29:07.595713 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-79581b37-ab98-427e-bf84-4ce223e01bef admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:29:07.596175 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-79581b37-ab98-427e-bf84-4ce223e01bef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:29:07.596598 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-79581b37-ab98-427e-bf84-4ce223e01bef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:29:07.597298 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-79581b37-ab98-427e-bf84-4ce223e01bef admin admin] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:29:07.597744 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-79581b37-ab98-427e-bf84-4ce223e01bef admin admin] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:29:07.598146 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: DEBUG oslo_concurrency.lockutils [None req-79581b37-ab98-427e-bf84-4ce223e01bef admin admin] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:29:07.619903 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: INFO nova.api.openstack.requestlog [None req-79581b37-ab98-427e-bf84-4ce223e01bef admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079929 Aug 08 14:29:07.620389 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: [pid: 103104|app: 0|req: 39/76] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Aug 8 14:29:07 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:30:02.404141 dv-cinder-852009-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 08 14:30:02.404659 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: Mon Aug 8 14:30:02 2022 - graceful shutdown triggered... Aug 08 14:30:02.405154 dv-cinder-852009-2-iscsi devstack@n-api.service[103105]: Gracefully killing worker 2 (pid: 103105)... Aug 08 14:30:02.405546 dv-cinder-852009-2-iscsi devstack@n-api.service[103104]: Gracefully killing worker 1 (pid: 103104)... Aug 08 14:30:03.405732 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: worker 1 buried after 1 seconds Aug 08 14:30:03.406294 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: worker 2 buried after 1 seconds Aug 08 14:30:03.406294 dv-cinder-852009-2-iscsi devstack@n-api.service[103103]: goodbye to uWSGI. Aug 08 14:30:03.407654 dv-cinder-852009-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 08 14:30:03.408287 dv-cinder-852009-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 08 14:30:03.411285 dv-cinder-852009-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 14:30:03.420411 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 14:30:03.422806 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 14:30:03 2022] *** Aug 08 14:30:03.422806 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 14:30:03.422806 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 14:30:03.422806 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: nodename: dv-cinder-852009-2-iscsi Aug 08 14:30:03.422806 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: machine: x86_64 Aug 08 14:30:03.422806 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: clock source: unix Aug 08 14:30:03.422806 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: pcre jit disabled Aug 08 14:30:03.422806 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: detected number of CPU cores: 4 Aug 08 14:30:03.422806 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: current working directory: / Aug 08 14:30:03.422806 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: detected binary path: /usr/bin/uwsgi-core Aug 08 14:30:03.423511 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: your processes number limit is 47680 Aug 08 14:30:03.423511 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: your memory page size is 4096 bytes Aug 08 14:30:03.423511 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: detected max file descriptor number: 2048 Aug 08 14:30:03.423511 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: lock engine: pthread robust mutexes Aug 08 14:30:03.423511 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: thunder lock: enabled Aug 08 14:30:03.423511 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 14:30:03.423511 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 14:30:03.462944 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: Python main interpreter initialized at 0x55e1616c49c0 Aug 08 14:30:03.462944 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: python threads support enabled Aug 08 14:30:03.462944 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: your server socket listen backlog is limited to 100 connections Aug 08 14:30:03.462944 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: your mercy for graceful operations on workers is 90 seconds Aug 08 14:30:03.464456 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 14:30:03.464456 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: *** Operational MODE: preforking *** Aug 08 14:30:03.464456 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: *** uWSGI is running in multiple interpreter mode *** Aug 08 14:30:03.464456 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: spawned uWSGI master process (pid: 118059) Aug 08 14:30:03.464090 dv-cinder-852009-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 14:30:03.466044 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: spawned uWSGI worker 1 (pid: 118060, cores: 1) Aug 08 14:30:03.466044 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: spawned uWSGI worker 2 (pid: 118062, cores: 1) Aug 08 14:30:03.466044 dv-cinder-852009-2-iscsi devstack@n-api.service[118059]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 14:30:04.138567 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 14:30:04.144725 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 14:30:05.301861 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 14:30:05.301861 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: from cryptography.utils import int_from_bytes Aug 08 14:30:05.302739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 14:30:05.302739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: from cryptography.utils import int_from_bytes Aug 08 14:30:05.316243 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 14:30:05.316243 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: from cryptography.utils import int_from_bytes Aug 08 14:30:05.316891 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 14:30:05.316891 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: from cryptography.utils import int_from_bytes Aug 08 14:30:07.641582 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 14:30:07.642112 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 14:30:07.642290 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 14:30:07.642842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 14:30:07.643133 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 14:30:07.643518 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.643842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.644160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.644480 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.644806 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.645114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.645430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.645745 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.646068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.646327 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.646641 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.646963 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-2-iscsi {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.647304 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.647611 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.647916 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.648230 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.648530 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.648847 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.649189 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.649687 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.650412 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.650945 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.651432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.651936 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.652405 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.652863 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.653375 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.653833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.654308 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.654781 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.655361 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-2-iscsi {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.655856 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.656332 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.656805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.657380 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.657851 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.658168 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.658493 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.658821 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.659165 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.659508 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.659826 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.660147 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.660466 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.660768 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.661077 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.661388 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.661709 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.662015 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.662327 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.662577 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.662888 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.663230 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.663555 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.663878 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.664130 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.664380 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.665224 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.665547 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.665862 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.666171 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.666481 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.666787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.667181 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.667432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.667753 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.668049 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.668368 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.668686 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.669011 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.669320 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.669638 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.670039 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.670288 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.670597 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.671200 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.671531 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.671839 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.672156 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.672474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.672787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.673098 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.673398 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.673716 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.674037 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.674340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.674591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.674890 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.675226 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.675554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.675851 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.676156 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.676463 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.676758 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.677060 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.677364 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.677667 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.677969 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.678273 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.678578 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.678884 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.679277 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.679735 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.680287 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.681125 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.681437 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.681746 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.682054 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.682359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.682682 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.682989 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.683318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.683640 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.683944 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.684252 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.684562 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.685032 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.685507 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.685841 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.686131 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.686437 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.686753 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.687059 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.687385 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.687694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.687995 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.688470 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.688780 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.689084 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.689388 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.689689 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.690014 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.690316 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.690626 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.690931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.691260 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.691578 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.691913 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.692245 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.692592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.692906 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.693241 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.693573 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.693893 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.694197 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.694509 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.694967 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.695357 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.695525 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.695758 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.696144 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.696453 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.696780 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.697256 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.697421 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.697762 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.698021 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.698338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.698665 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.698990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.699323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.699679 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.700009 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.700330 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.700641 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.700960 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.701271 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.701579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.701888 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.702210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.702548 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.702863 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.703203 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.703517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.703827 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.703986 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 14:30:07.704503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.704695 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 14:30:07.704892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.704892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.705189 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 14:30:07.705345 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.705490 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 14:30:07.705490 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 14:30:07.705779 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.705779 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.706066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.706210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.706360 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.706614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.706930 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.707106 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.707268 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.707413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.707608 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.707767 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.708011 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.708169 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.708333 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.708562 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.708811 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.708996 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.709231 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.709398 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.709615 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.709856 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.710032 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.710284 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.710434 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-2-iscsi {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.710586 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.710737 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.710888 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.711184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.711910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.712069 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.712227 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.712372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.712529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.712682 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.712832 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.712977 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.713120 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.713264 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.713420 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.713420 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.713703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.713884 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.714039 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.714192 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.714338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.714492 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.714651 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.715435 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.715598 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.715763 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.715919 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.716075 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.716075 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.716349 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.716514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.716673 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.716835 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.717065 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.717213 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.717360 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.717511 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.717664 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.717809 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.717953 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-2-iscsi {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.718197 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.718354 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.718578 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.718829 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.719047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.719269 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.719493 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.719674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.719972 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.720123 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.720292 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.720539 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.720698 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.720853 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.720997 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.721169 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.721405 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.721555 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.721709 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.721709 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.722005 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.722157 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.722302 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.722450 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.722608 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.722761 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.722905 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.723056 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.723245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.723399 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.723552 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.723698 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.723849 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.724001 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.724153 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.724298 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.724450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.724594 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.724739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.724926 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.725084 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.725239 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.725392 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.725536 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.725686 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.725839 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.725991 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.726149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.726293 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.726448 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.726595 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.726750 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.726896 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.727828 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.727990 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.728147 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.728398 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.728557 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.728715 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.728966 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.729216 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.729572 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.729733 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.729904 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.730195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.730356 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.730533 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.730770 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.730926 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.731080 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.731250 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.731434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.731675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.731835 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.731987 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.732711 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.732884 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.733047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.733207 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.733358 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.733510 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.733666 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.733948 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.734113 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.734275 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.734421 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.734571 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.734723 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.734875 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.735077 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.735077 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.735402 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.735556 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.735709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.735862 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.736007 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.736159 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.736304 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.736469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.736625 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.736778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.736923 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.737075 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.737235 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.737387 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.737540 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.737763 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.738009 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.738169 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.738325 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.738576 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.738727 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.738727 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.738727 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.738727 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.738727 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.738727 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.738727 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.738727 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.741967 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.741967 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.741967 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.742395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.742636 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.742636 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.742636 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.742636 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.742636 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.742636 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.744071 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.744278 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.744437 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.744591 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.744745 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.744890 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.744890 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.745258 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.745410 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.745554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.745707 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.745859 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.746017 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.746172 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.746323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.746486 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.746639 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.746792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.746944 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.747104 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.747255 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.747416 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.747561 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.747710 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.747864 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.748034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.748269 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.748429 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.748591 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.748825 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.748984 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.750002 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.750159 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.750410 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.750602 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.750830 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.751278 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.751439 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.751592 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.751860 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.752149 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.752303 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.752503 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.752654 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.752807 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.752952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.753108 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.753253 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.753406 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.753562 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.753708 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.753851 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.754005 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.754151 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.754302 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.754455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.754600 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.754752 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.754907 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.755052 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.755252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.755412 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.755568 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.755727 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.755873 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.756017 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.756170 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.756322 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.756485 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 14:30:07.756641 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.756786 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.756938 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.757091 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.757245 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.757398 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.757562 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.757562 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.757852 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.757996 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.758141 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.758431 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.758594 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.758747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.759001 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.759173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.759324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.759499 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.759828 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.760088 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.760284 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.760526 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.760684 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.760861 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.761092 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.761241 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.761392 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.761538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.761682 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.761856 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.762128 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.762527 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.762687 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.762833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.762986 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.763220 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.763373 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.763675 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.763831 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.763987 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.764147 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.764293 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.764400 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.764495 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.764625 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.764742 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.764833 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.764926 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.765011 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.765093 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.765093 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.765296 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.765403 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.765496 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.765496 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.765656 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.765738 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.765829 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.765829 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.765987 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.766078 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.766170 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.766254 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.766351 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.766491 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.766586 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.766670 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.766760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.766851 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.766947 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.767032 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.767142 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.767246 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.767331 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.767414 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.767496 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.767578 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.767660 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.767823 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.767910 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.767993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.768087 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.768172 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.768261 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.768372 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.768459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.768592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.768685 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.768769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.768852 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.768947 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.769061 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.769153 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.769237 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.769327 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.769327 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.769495 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.769586 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.769684 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.769792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.769876 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.769968 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.770223 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.770328 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.770420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.770526 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.770612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.770704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.770803 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.770894 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.770984 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.771179 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.771275 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.771372 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.771458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.771458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.771640 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.771640 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.771803 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.771895 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.771980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.771980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.772150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.772246 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.772339 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.772418 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.772500 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.772583 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.772672 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.772756 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.772846 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.772937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.773021 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.773103 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.773184 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.773184 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.773341 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.773425 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.773506 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.773588 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.773677 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.773760 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.773850 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.773965 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.774061 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.774146 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.774229 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.774324 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.774408 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.774489 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.774585 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.774670 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.774751 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.774841 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.774931 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.775015 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.775252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.775406 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.775501 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.775595 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.775688 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.775784 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.775875 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.775959 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.776054 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.776139 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.776230 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.776314 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.776403 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.776498 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.776595 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.776679 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.776761 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.776842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.776931 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.777022 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.777118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.777208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.777208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.777359 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.777440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.777522 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.777617 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.777708 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.777798 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.777888 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.778047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.778149 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.778366 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.778465 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.778672 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.778770 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.778969 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.779068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.779340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.779551 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.779649 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.779748 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.779881 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.783590 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.783681 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.783767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.783900 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.783997 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.784098 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.784194 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.784268 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.784351 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.784434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.784547 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.784650 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.784735 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.784818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.784898 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.784970 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.785040 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.785195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.785292 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.785377 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.785620 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.785718 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.785812 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.785893 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.785966 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.786044 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.786122 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.786202 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.786283 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.786355 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.786432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.786511 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.786583 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.786583 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.786583 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.786583 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.786892 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.786971 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.787050 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.787164 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.787240 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.787319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.787412 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.787497 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.787586 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.787586 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.787753 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.787836 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.788454 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.788570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.788667 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.788762 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.788904 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.788999 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.789243 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.789335 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.790214 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.790350 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.790442 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.790734 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.790835 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.791055 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.791334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.791505 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.791665 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.791829 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.792213 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.792494 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.792597 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.792685 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.792780 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.793003 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.793129 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.793370 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.793474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.793686 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.793890 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.794012 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.794326 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.794423 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.794649 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.794832 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.794955 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.795300 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.795410 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.795638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.795774 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.796228 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.796340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.796543 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.796655 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.796856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.796966 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.797174 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.797281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.797484 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.797592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.797792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.797909 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.798102 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.798212 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.798412 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.798521 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.798722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.798823 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.799029 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.799162 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.799361 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.799472 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.799671 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.799779 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.799980 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.800081 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.800284 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.800399 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.800627 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.800744 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.800910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.801009 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.801211 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.801307 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.801521 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.801630 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.801823 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.801922 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.802129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.802314 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.802450 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.802543 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.802771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.802878 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.803121 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.803258 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.803426 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.803522 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.803735 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.803835 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.804059 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.804152 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.804365 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.804456 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.804677 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.804792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.804980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.805080 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.805854 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.806025 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.806183 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.806277 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.806499 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.806607 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.806808 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.806902 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.807153 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.807266 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.807460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.807563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.807760 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.807855 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.808065 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.808172 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.808385 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.808485 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.808684 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.808789 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.808985 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.809092 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.809286 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.809378 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.809610 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.809719 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.809914 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.810021 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.810217 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.810351 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.810532 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.810673 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.810830 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.811011 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.811288 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.811378 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.811602 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.811692 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.811927 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.812019 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.812231 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.812321 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.812536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.812632 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.812850 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.812953 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.813166 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.813274 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.813470 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.813754 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.813865 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.814078 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.814193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.814396 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.814497 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.814715 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.814817 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.815022 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.815153 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.815359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.815472 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.815661 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.815755 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.815980 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.816080 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.816297 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.816397 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.816606 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.816707 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.816924 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.817029 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.817244 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.817341 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.817551 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.817649 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.817867 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.817968 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.818179 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.818286 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.818488 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.818580 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.818795 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.818894 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.819139 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.819247 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.819435 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.819534 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.819734 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.819836 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.820038 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.820129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.820344 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.820436 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.820642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.820750 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.821464 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.821611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.821771 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.821931 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.822076 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.822245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.822376 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.822573 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.822716 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.822902 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.823013 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.823215 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.823310 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.823539 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.823638 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.823830 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.823944 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.824175 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.824268 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.824486 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.824584 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.824787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.824878 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.825104 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.825196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.825409 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.825510 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.825709 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.825801 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.826008 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.826098 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.826306 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.826410 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.826644 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.826752 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.826946 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.827115 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.827272 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.827362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.827584 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.827686 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.827894 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.828026 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.828200 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.828316 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.828511 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.828613 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.828820 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.828957 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.829130 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.829238 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.829419 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.829534 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.829725 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.829818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.830035 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.830136 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.830330 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.830422 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.830634 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.830729 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.830933 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.831136 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.831238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.831332 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.831615 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.831758 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.831862 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.831955 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.832135 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.832245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.832439 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.832541 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.832808 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.832938 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.833047 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.833141 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.833338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.833440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.833644 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.833766 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.833944 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.834051 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.834235 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.834374 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.834527 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.834665 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.834807 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.834955 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.835130 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.835233 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.835453 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.835552 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.835762 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.835861 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.836064 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.836182 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.836368 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.836498 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.837223 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.837335 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.837525 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.837624 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.837833 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.837925 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.838140 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.838226 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.838466 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.838674 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.838785 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.838999 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.839080 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.839338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.839435 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.839846 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.839962 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.840044 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.840197 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.840508 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.840910 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.841150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.841257 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.841347 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.841468 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.841835 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.841954 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.842044 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.842253 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.842360 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.842500 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.842644 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.842829 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.843194 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.843456 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.843768 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.844082 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.844398 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.844543 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.844692 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.844878 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.845000 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.845207 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.845326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.845531 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.845645 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.845897 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.845987 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.846216 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.846313 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.846587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.846713 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.846897 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.846998 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.847236 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.847341 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.847539 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.847631 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.847867 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.847974 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.848189 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.848288 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.848490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.848581 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.848799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.848899 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.849110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.849208 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.849420 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.849512 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.849725 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.849818 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.850031 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.850123 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.850338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.850429 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.850645 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.850738 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.850951 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.851044 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.851280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.851390 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.851590 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.851706 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.851935 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.852068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.852721 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.852829 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.853055 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.853158 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.853375 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.853502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.853682 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.853793 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.853995 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.854149 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.854306 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.854408 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.854623 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.854829 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.854924 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.855163 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.855272 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.855495 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.855602 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.855816 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.855917 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.856134 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.856234 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.856451 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.856575 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.856766 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.856871 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.857088 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.857190 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.857470 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.857588 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.857771 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.857868 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.858048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.858208 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.858368 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.858530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.858757 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.858911 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.859064 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.859282 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.859447 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.859625 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.859796 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.859958 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.860119 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.860280 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.860442 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.860595 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.860595 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.860891 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.861144 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.861303 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.861466 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.861628 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.861789 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.861954 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.862210 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.862369 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.862531 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.862683 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.862833 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.862991 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.863163 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.863272 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.863272 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.863457 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.863551 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.863643 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.863728 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.863826 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.863961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.864056 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.864269 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.864371 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.864570 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.864676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.864878 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.864979 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.865186 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.865278 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.865483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.865588 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.865788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.865888 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.866084 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.866182 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.866405 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.866513 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.866705 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.866799 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.867005 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.867168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.867326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.867488 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.867634 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.868392 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.868818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.869055 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.869169 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.869459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.869567 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.869807 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.869908 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.870123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.870217 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.870432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.870524 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.870744 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.870884 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.871051 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.871265 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.871387 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.871550 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.871691 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.871868 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.871999 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.872198 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.872286 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.872611 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.872925 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.873036 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.873274 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.873369 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.873593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.873684 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.873906 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.874023 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.874232 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.874340 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.874542 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.874638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.874851 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.874948 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.875255 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.875375 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.875529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.875655 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.875944 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.876075 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.876398 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.876719 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.877051 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.877380 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.878214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.878313 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.878407 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.878510 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.878590 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.878735 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.878900 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.879069 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.879234 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.879423 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.879545 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.879757 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.879856 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.880082 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.880181 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.880406 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.880505 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.880741 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.880839 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.881052 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.881152 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.881360 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.881451 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.881665 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.881764 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.881973 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.882076 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.882280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.882377 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.882587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.882686 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.882931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.883044 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.883220 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.883365 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.883561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.883661 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.883972 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.884086 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.884231 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.884341 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.884529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.884635 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.884840 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.884931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.885150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.885250 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.885457 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.885549 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.885762 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.885853 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.886066 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.886168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.886370 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.886462 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.886681 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.886781 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.887002 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.887126 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.887352 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.887446 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.887653 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.887746 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.888007 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.888105 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.888323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.888416 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.888663 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.889219 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.889219 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.889397 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.889480 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.889570 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.889667 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.889876 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.889973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.890184 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.890267 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.890501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.890602 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.890807 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.890908 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.891148 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.891246 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.891487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.891581 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.891840 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.891946 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.892104 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.892204 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.892408 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.892505 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.892711 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.892804 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.893041 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.893153 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.893316 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.893421 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.893634 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.893770 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.893938 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.894045 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.894239 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.894354 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.894543 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.894636 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.894849 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.894942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.895176 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.895267 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.895481 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.895584 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.895783 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.895883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.896083 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.896176 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.896388 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.896487 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.896687 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.896784 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.896986 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.897085 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.897285 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.897377 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.897585 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.897676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.897914 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.898002 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.898338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.898438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.898521 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.898607 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.898799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.898907 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.899297 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.899423 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.899547 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.899674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.899834 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.899942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.900029 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.900113 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.900325 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.900432 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.900653 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.900963 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.901053 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.901282 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.901382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.901591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.901684 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.901907 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.902004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.902211 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.902311 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.902528 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.902625 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.902845 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.902936 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.903193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.903466 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.903586 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.903678 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.903870 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.903971 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.904108 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.904308 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.904453 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.904549 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.904763 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.904910 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.905062 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.905220 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.905362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.905503 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.905662 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.905800 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.905933 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.906074 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.906257 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.906393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.906562 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.906706 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.906883 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.907027 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.907203 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.907355 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.907509 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.907659 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.907819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.907914 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.908127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.908228 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.908452 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.908553 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.908759 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.908854 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.909066 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.909159 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.909375 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.909495 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.909679 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.909772 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.909984 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.910076 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.910293 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.910387 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.910596 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.910695 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.910904 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.910995 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.911236 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.911333 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.911550 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.911706 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.911874 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.912032 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.912192 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.912350 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.912496 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.912677 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.912817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.912998 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.913136 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.913478 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.913576 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.913787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.913880 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.914127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.914228 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.914448 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.915138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.915318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.915456 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.915677 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.915826 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.915975 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.916128 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.916214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 14:30:07.916359 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.916568 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.916878 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.917193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.917507 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.917815 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.918141 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.918456 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.918764 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.919120 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.919425 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.919992 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.920344 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.920665 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.921250 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.921608 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.921931 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.922238 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.922574 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.922885 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.923226 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.923555 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.923871 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.924179 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.924490 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.924807 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.925120 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.925431 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.925746 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.926052 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.926382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.926691 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.926998 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.927332 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.927647 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.927956 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.928264 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.928570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.928879 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.929196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.929507 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.929824 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.930132 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.930514 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.931344 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.931660 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.931969 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.932309 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.932626 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.932987 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.933312 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.933629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.933955 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.934273 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.934588 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.934949 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.935296 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.935901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.936240 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.936566 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.936913 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.937251 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.937563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.937874 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.938184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.938513 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.938829 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.939187 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.939509 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.939845 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.940138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.940453 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.940769 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.941085 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.941398 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.941714 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.942106 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.942427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.942750 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.943064 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.943412 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.943773 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.944096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.944443 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.944763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.945083 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.945395 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.945710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.946296 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.946617 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.946943 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.947306 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.947632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.947945 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.948562 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.948888 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.949449 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.949820 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.950148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.950482 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.950811 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.951297 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.951635 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.951956 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.952468 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.952830 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.953170 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.953500 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.953894 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.954125 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.954436 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.954756 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.955124 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.955428 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.955738 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.956047 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.956363 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.956675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.956985 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.957295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.957603 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.957917 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.958226 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.958535 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.958865 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.959198 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.959509 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.959817 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.960130 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.960440 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.960755 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.961063 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.961373 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.961723 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.962070 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.962406 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.962734 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.963064 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.963411 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.963739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.964058 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.964383 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.964707 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.965030 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.965345 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.965681 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.965993 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.966307 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.966621 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.966934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.967281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.967584 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.967924 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.968257 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.968568 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.968899 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.969220 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.969546 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.969866 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.970183 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.970515 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.970829 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.971169 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.971484 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.971801 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.972117 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.972437 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.972758 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.973073 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.973391 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.973710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.974043 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.974376 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.974689 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.975018 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.975378 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.975737 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.976054 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.976409 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.976740 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.977623 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.977910 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.978219 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 14:30:07.978467 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 14:30:08.068128 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO dbcounter [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] Registered counter for database nova_api Aug 08 14:30:08.088290 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_db.sqlalchemy.engines [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:30:08.094770 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writer thread running {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:30:08.130365 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO dbcounter [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] Registered counter for database nova_api Aug 08 14:30:08.150721 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_db.sqlalchemy.engines [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:30:08.151665 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.context [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dbc50433-daea-4bbf-a66d-720f9de1a6a6(cell1) {{(pid=118062) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 14:30:08.155730 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:30:08.156198 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:30:08.157248 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writer thread running {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:30:08.157731 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:30:08.158465 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:30:08.158909 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:30:08.161032 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:30:08.162962 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO dbcounter [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] Registered counter for database nova_cell0 Aug 08 14:30:08.167462 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO dbcounter [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] Registered counter for database nova_cell1 Aug 08 14:30:08.178474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_db.sqlalchemy.engines [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:30:08.181282 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_db.sqlalchemy.engines [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:30:08.186098 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writer thread running {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:30:08.217168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.context [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dbc50433-daea-4bbf-a66d-720f9de1a6a6(cell1) {{(pid=118060) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 14:30:08.221269 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:30:08.221754 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:30:08.223388 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:30:08.224099 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:30:08.224554 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:30:08.226571 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:30:08.228731 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO dbcounter [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] Registered counter for database nova_cell0 Aug 08 14:30:08.232890 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO dbcounter [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] Registered counter for database nova_cell1 Aug 08 14:30:08.240416 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_db.sqlalchemy.engines [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:30:08.243351 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_db.sqlalchemy.engines [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:30:08.248894 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writer thread running {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:30:08.250493 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writer thread running {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:30:08.323606 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writer thread running {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:30:08.333754 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO dbcounter [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] Registered counter for database nova_cell0 Aug 08 14:30:08.341289 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_db.sqlalchemy.engines [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:30:08.347473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writer thread running {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:30:08.405427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO dbcounter [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] Registered counter for database nova_cell0 Aug 08 14:30:08.414430 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_db.sqlalchemy.engines [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 14:30:08.419623 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writer thread running {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 14:30:08.678341 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: WARNING keystonemiddleware.auth_token [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 14:30:08.686146 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: WARNING keystonemiddleware.auth_token [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 14:30:08.750253 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: WARNING keystonemiddleware.auth_token [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 14:30:08.757634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: WARNING keystonemiddleware.auth_token [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 14:30:09.045439 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: WARNING keystonemiddleware.auth_token [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 14:30:09.051740 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: WARNING keystonemiddleware.auth_token [None req-f084c5ee-2fc9-4e16-a35e-98095097c4e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 14:30:09.058222 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e1616c49c0 pid: 118062 (default app) Aug 08 14:30:09.107744 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: WARNING keystonemiddleware.auth_token [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 14:30:09.113767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: WARNING keystonemiddleware.auth_token [None req-460eab4e-fa65-4c45-a0ca-a74e96b659ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 14:30:09.120374 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e1616c49c0 pid: 118060 (default app) Aug 08 14:30:44.484651 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=3 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:30:44.485821 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=3 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:30:44.486861 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=3 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:30:44.487919 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=3 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:30:44.901827 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:30:44.902963 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:30:44.904452 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:30:44.906013 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:30:46.077392 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f05f4536-8911-45c0-ae71-5169e95ece80 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Action: 'create', calling method: .version_select at 0x7f9cb4507dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-995590240"}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:30:46.349745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-35905e48-af8f-427b-a6cf-630f79f188ab tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] Action: 'create', calling method: .version_select at 0x7f9cb4506dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-420169557", "metadata": {"Type": "work"}}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:30:47.699193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-35905e48-af8f-427b-a6cf-630f79f188ab tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.805665 Aug 08 14:30:47.701252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 1/1] 10.222.0.50 () {60 vars in 1156 bytes} [Mon Aug 8 14:30:44 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2811 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 14:30:47.722437 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b3e08f10-14fb-4565-8cdd-bb6c3cd9d93c tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] Calling method '.version_select at 0x7f9cb43f5c10>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:47.891805 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b3e08f10-14fb-4565-8cdd-bb6c3cd9d93c tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/08a699ca-4536-495f-a47d-aefcd9ddec86" status: 200 len: 352 microversion: 2.1 time: 0.178466 Aug 08 14:30:47.893434 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 2/2] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 14:30:47 2022] GET /compute/v2.1/os-volumes/08a699ca-4536-495f-a47d-aefcd9ddec86 => generated 352 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:48.007404 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f05f4536-8911-45c0-ae71-5169e95ece80 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.527935 Aug 08 14:30:48.008069 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 1/3] 10.222.0.50 () {60 vars in 1155 bytes} [Mon Aug 8 14:30:44 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3531 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 14:30:48.022222 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c38548ae-0db8-4204-bd69-87c18177864e tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb4397310>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:48.126861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c38548ae-0db8-4204-bd69-87c18177864e tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67" status: 200 len: 344 microversion: 2.1 time: 0.108423 Aug 08 14:30:48.128371 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 3/4] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 14:30:48 2022] GET /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67 => generated 344 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:48.909148 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-635c7e7f-73c3-486d-acf0-aa0ca064963c tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] Calling method '.version_select at 0x7f9cb43f3c10>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:49.032395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-635c7e7f-73c3-486d-acf0-aa0ca064963c tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/08a699ca-4536-495f-a47d-aefcd9ddec86" status: 200 len: 353 microversion: 2.1 time: 0.128222 Aug 08 14:30:49.033090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 2/5] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 14:30:48 2022] GET /compute/v2.1/os-volumes/08a699ca-4536-495f-a47d-aefcd9ddec86 => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:49.046788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-421acfb3-ccc2-4096-9563-852c4d1f080f tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] Calling method '.version_select at 0x7f9cb4397a60>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:49.142933 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-51ccb1be-dcf4-42e7-84df-293cfd7a7df7 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb43953a0>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:49.254972 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-51ccb1be-dcf4-42e7-84df-293cfd7a7df7 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67" status: 200 len: 345 microversion: 2.1 time: 0.116436 Aug 08 14:30:49.256359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 3/6] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 14:30:49 2022] GET /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67 => generated 345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:49.269917 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bf7f1b12-de4f-45d6-b17c-e7eca2bb8f53 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Action: 'create', calling method: .version_select at 0x7f9cb43959d0>, body: {"snapshot": {"volume_id": "5e9adad1-0df0-4ace-99c4-cc68ca837b67", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1474390748"}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:30:49.352680 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-421acfb3-ccc2-4096-9563-852c4d1f080f tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/08a699ca-4536-495f-a47d-aefcd9ddec86" status: 200 len: 353 microversion: 2.1 time: 0.310469 Aug 08 14:30:49.353796 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 14:30:49 2022] GET /compute/v2.1/os-volumes/08a699ca-4536-495f-a47d-aefcd9ddec86 => generated 353 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:49.375004 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-89bb88ad-a219-422f-be44-3e83460f16de tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] Calling method '.version_select at 0x7f9cb43f5dc0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:49.508657 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-89bb88ad-a219-422f-be44-3e83460f16de tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/08a699ca-4536-495f-a47d-aefcd9ddec86" status: 202 len: 0 microversion: 2.1 time: 0.137501 Aug 08 14:30:49.514526 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 5/8] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 14:30:49 2022] DELETE /compute/v2.1/os-volumes/08a699ca-4536-495f-a47d-aefcd9ddec86 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:30:49.521497 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d6fc4afb-364c-4d2d-a629-b69ef84d860e tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] Calling method '.version_select at 0x7f9cb4397af0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:49.636609 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d6fc4afb-364c-4d2d-a629-b69ef84d860e tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/08a699ca-4536-495f-a47d-aefcd9ddec86" status: 200 len: 352 microversion: 2.1 time: 0.120317 Aug 08 14:30:49.637701 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 6/9] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 14:30:49 2022] GET /compute/v2.1/os-volumes/08a699ca-4536-495f-a47d-aefcd9ddec86 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:49.972215 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bf7f1b12-de4f-45d6-b17c-e7eca2bb8f53 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.706841 Aug 08 14:30:49.973190 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 4/10] 10.222.0.50 () {60 vars in 1162 bytes} [Mon Aug 8 14:30:49 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:30:49.985270 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a16790dc-5103-44ad-827a-51f06b351926 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb4397310>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:50.078304 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a16790dc-5103-44ad-827a-51f06b351926 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7" status: 200 len: 287 microversion: 2.1 time: 0.097109 Aug 08 14:30:50.079384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 7/11] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 14:30:49 2022] GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:50.091409 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-cd2f512e-6364-411d-894f-7ed60ab3bfab tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb4395d30>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:50.146386 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-cd2f512e-6364-411d-894f-7ed60ab3bfab tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.059881 Aug 08 14:30:50.147392 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 5/12] 10.222.0.50 () {58 vars in 1140 bytes} [Mon Aug 8 14:30:50 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:50.158959 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fad0a3e6-4918-4e89-8f90-8d80606a80c2 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb4397280>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:50.219793 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fad0a3e6-4918-4e89-8f90-8d80606a80c2 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7" status: 200 len: 287 microversion: 2.1 time: 0.064639 Aug 08 14:30:50.225115 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 8/13] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 14:30:50 2022] GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:50.652160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0cbc5f04-7a2a-4661-846c-04af307ca2a2 tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] Calling method '.version_select at 0x7f9cb43f3af0>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:50.708267 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-0cbc5f04-7a2a-4661-846c-04af307ca2a2 tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] HTTP exception thrown: Volume 08a699ca-4536-495f-a47d-aefcd9ddec86 could not be found. Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0cbc5f04-7a2a-4661-846c-04af307ca2a2 tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] Request method failure captured: Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/os-volumes/08a699ca-4536-495f-a47d-aefcd9ddec86 HTTP/1.1 Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4U09wGCYuXUFgRRmaflihnozUMraBh5CDGqmR1LO3uC-UOx_vjMksaTNy6mlMV7g4sh0tCNm9j7au06NpxUspGMX-IMS0BRxRygxmUKte-ultE1EohXDaisqhiCtSMTS-JUWr_MK3KcktDhdf2XwqF0fCfW9sttqShFlDS0YjKCHg Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: bdcd265da07a488cb1b022a41d2503ae Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-VolumesGetTestJSON-1134476384 Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:30:50.712739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:30:50.713879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bdcd265da07a488cb1b022a41d2503ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bdcd265da07a488cb1b022a41d2503ae", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bdcd265da07a488cb1b022a41d2503ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bdcd265da07a488cb1b022a41d2503ae"}]}] Aug 08 14:30:50.713879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-VolumesGetTestJSON-1134476384 Aug 08 14:30:50.713879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: bdcd265da07a488cb1b022a41d2503ae Aug 08 14:30:50.713879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-VolumesGetTestJSON-1134476384 Aug 08 14:30:50.713879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-VolumesGetTestJSON-1134476384-project Aug 08 14:30:50.713879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:30:50.713879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:30:50.713879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: bee7fd2630f94e8ab54b181c4a761535 Aug 08 14:30:50.713879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-VolumesGetTestJSON-1134476384-project Aug 08 14:30:50.713879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: Aug 08 14:30:50.713879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Volume 08a699ca-4536-495f-a47d-aefcd9ddec86 could not be found. Aug 08 14:30:50.713879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': '08a699ca-4536-495f-a47d-aefcd9ddec86'} Aug 08 14:30:50.713879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08a699ca-4536-495f-a47d-aefcd9ddec86 could not be found. (HTTP 404) (Request-ID: req-f6bfcc1b-fe70-4111-954d-9197097d2554) Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:50.714529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 14:30:50.715503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08a699ca-4536-495f-a47d-aefcd9ddec86 could not be found. Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 14:30:50.716490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:30:50.718604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 08a699ca-4536-495f-a47d-aefcd9ddec86 could not be found. Aug 08 14:30:50.718604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:50.718604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:50.718604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:50.718604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:50.718604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:30:50.718604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:30:50.718604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:30:50.718604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:30:50.718604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08a699ca-4536-495f-a47d-aefcd9ddec86 could not be found. Aug 08 14:30:50.718604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:50.718604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0cbc5f04-7a2a-4661-846c-04af307ca2a2 tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] Returning 404 to user: Volume 08a699ca-4536-495f-a47d-aefcd9ddec86 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:30:50.718604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0cbc5f04-7a2a-4661-846c-04af307ca2a2 tempest-VolumesGetTestJSON-1134476384 tempest-VolumesGetTestJSON-1134476384-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/08a699ca-4536-495f-a47d-aefcd9ddec86" status: 404 len: 109 microversion: 2.1 time: 0.069193 Aug 08 14:30:50.718604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 6/14] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 14:30:50 2022] GET /compute/v2.1/os-volumes/08a699ca-4536-495f-a47d-aefcd9ddec86 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:30:51.234215 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6eb13624-82d1-4422-8654-e6c559862923 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb4397af0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:51.448793 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6eb13624-82d1-4422-8654-e6c559862923 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7" status: 200 len: 287 microversion: 2.1 time: 0.219474 Aug 08 14:30:51.450491 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 9/15] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 14:30:51 2022] GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 => generated 287 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:52.466350 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-40070abd-9158-4d8b-a6bd-e334ca387a68 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb439a4c0>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:52.534592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-40070abd-9158-4d8b-a6bd-e334ca387a68 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7" status: 200 len: 287 microversion: 2.1 time: 0.076511 Aug 08 14:30:52.535455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 7/16] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 14:30:52 2022] GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:53.555589 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bf350be5-4eef-4f4f-b6be-972f26ac6d39 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb43f5b80>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:53.617104 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bf350be5-4eef-4f4f-b6be-972f26ac6d39 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7" status: 200 len: 288 microversion: 2.1 time: 0.072311 Aug 08 14:30:53.618219 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 10/17] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 14:30:53 2022] GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:53.630930 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c84a2d2c-5160-4775-b59c-6309eacfd4b2 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb439ac10>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:53.779119 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c84a2d2c-5160-4775-b59c-6309eacfd4b2 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7" status: 202 len: 0 microversion: 2.1 time: 0.153092 Aug 08 14:30:53.780658 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 8/18] 10.222.0.50 () {58 vars in 1254 bytes} [Mon Aug 8 14:30:53 2022] DELETE /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:30:53.790512 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-227e672b-50ba-40b0-92d3-94c001f4893b tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb43a6310>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:53.848093 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-227e672b-50ba-40b0-92d3-94c001f4893b tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7" status: 200 len: 287 microversion: 2.1 time: 0.059028 Aug 08 14:30:53.848670 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 11/19] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 14:30:53 2022] GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:54.861825 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4b6f2a5f-8788-40ad-860b-a128a3d99aca tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb43f5b80>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:54.952889 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4b6f2a5f-8788-40ad-860b-a128a3d99aca tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7" status: 200 len: 287 microversion: 2.1 time: 0.095196 Aug 08 14:30:54.959868 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 12/20] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 14:30:54 2022] GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:55.370872 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-29c8c297-7209-4b8f-8bb6-0f47a75e10b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Action: 'create', calling method: .version_select at 0x7f9cb439ad30>, body: {"keypair": {"name": "tempest-keypair-564161905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqjB4vb28BEQZs8Do3slZzAjJQJCAl8pMYLr1trfE99lp+8Z5Vzwx6B1dMlxHCF70d6GZ/YKeLGsNlCkZ60vS+NsECXSrTjEmZFTnteuNAWvhHxhdx1n6zL8FOu/sVfgQ=="}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:30:55.491774 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-29c8c297-7209-4b8f-8bb6-0f47a75e10b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Getting quotas for project fa2ecaeb6faf4c1ea5eac70b19398b42. Resources: {'key_pairs'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:30:55.511239 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-29c8c297-7209-4b8f-8bb6-0f47a75e10b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Getting quotas for user 84d2f3c3c5fb4cceabf9a35f64a1551c and project fa2ecaeb6faf4c1ea5eac70b19398b42. Resources: {'key_pairs'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:30:55.586101 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-29c8c297-7209-4b8f-8bb6-0f47a75e10b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.808707 Aug 08 14:30:55.588724 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 9/21] 10.222.0.50 () {62 vars in 1200 bytes} [Mon Aug 8 14:30:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 812 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 14:30:55.966317 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-89d167a6-4f5a-41bc-9e0f-1a0f10a4be2b tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb4397c10>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:56.050888 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-89d167a6-4f5a-41bc-9e0f-1a0f10a4be2b tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7" status: 200 len: 287 microversion: 2.1 time: 0.089073 Aug 08 14:30:56.052388 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 13/22] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 14:30:55 2022] GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:30:57.069261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9b3b2c35-fc90-4533-a4a9-43750766f30c tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb3a8d430>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:57.101284 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-9b3b2c35-fc90-4533-a4a9-43750766f30c tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] HTTP exception thrown: Snapshot fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 could not be found. Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9b3b2c35-fc90-4533-a4a9-43750766f30c tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Request method failure captured: Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 HTTP/1.1 Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4Uz5FAngHemd95_Cgl0yqnXAe2ZkM4i5ZZO0tm7G2FICdVJiUulyq6ALgref5ZFb58MiRRsmo8A0xkQB4cNRxlQv3dpljaU7GLE7XmeH7gs_ovdVbpbks8-a_b_yg27Tsg8g8kDdpeo6SLP_sINsbxxPsEyaqNT2FbfCGL_yNjXBA Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 450cacbbb551460198179c4a0c7c18ac Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-867655217 Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:30:57.104805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:30:57.106145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/450cacbbb551460198179c4a0c7c18ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_450cacbbb551460198179c4a0c7c18ac", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/450cacbbb551460198179c4a0c7c18ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/450cacbbb551460198179c4a0c7c18ac"}]}] Aug 08 14:30:57.106145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-VolumesSnapshotsTestJSON-867655217 Aug 08 14:30:57.106145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 450cacbbb551460198179c4a0c7c18ac Aug 08 14:30:57.106145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-867655217 Aug 08 14:30:57.106145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-VolumesSnapshotsTestJSON-867655217-project Aug 08 14:30:57.106145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:30:57.106145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:30:57.106145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: a193081e23864453987cd63da6493049 Aug 08 14:30:57.106145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-VolumesSnapshotsTestJSON-867655217-project Aug 08 14:30:57.106145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: Aug 08 14:30:57.106145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Snapshot fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 could not be found. Aug 08 14:30:57.106145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': 'fd8b34c6-8598-475d-a9cc-01ae2cfb18c7'} Aug 08 14:30:57.106145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 could not be found. (HTTP 404) (Request-ID: req-d2db9a83-d699-48e5-af9d-7a58c35c3f7d) Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.106998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 14:30:57.108145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 could not be found. Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 08 14:30:57.110091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:30:57.112533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 could not be found. Aug 08 14:30:57.112533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.112533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:57.112533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.112533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:57.112533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:30:57.112533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:30:57.112533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:30:57.112533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:30:57.112533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 could not be found. Aug 08 14:30:57.112533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.114862 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9b3b2c35-fc90-4533-a4a9-43750766f30c tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Returning 404 to user: Snapshot fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:30:57.115948 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9b3b2c35-fc90-4533-a4a9-43750766f30c tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7" status: 404 len: 111 microversion: 2.1 time: 0.054093 Aug 08 14:30:57.127188 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-da24fb5b-bcb8-4a2d-bc01-000ae0bbd906 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb43973a0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:57.131606 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 10/23] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 14:30:57 2022] GET /compute/v2.1/os-snapshots/fd8b34c6-8598-475d-a9cc-01ae2cfb18c7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:30:57.248981 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-da24fb5b-bcb8-4a2d-bc01-000ae0bbd906 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67" status: 202 len: 0 microversion: 2.1 time: 0.126252 Aug 08 14:30:57.259255 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 14/24] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 14:30:57 2022] DELETE /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:30:57.261393 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-32d5979b-d70b-40f2-87a0-b0a158c7761f tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb3a8d1f0>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:57.460426 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-32d5979b-d70b-40f2-87a0-b0a158c7761f tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] HTTP exception thrown: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-32d5979b-d70b-40f2-87a0-b0a158c7761f tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Request method failure captured: Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67 HTTP/1.1 Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4Uz5FAngHemd95_Cgl0yqnXAe2ZkM4i5ZZO0tm7G2FICdVJiUulyq6ALgref5ZFb58MiRRsmo8A0xkQB4cNRxlQv3dpljaU7GLE7XmeH7gs_ovdVbpbks8-a_b_yg27Tsg8g8kDdpeo6SLP_sINsbxxPsEyaqNT2FbfCGL_yNjXBA Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 450cacbbb551460198179c4a0c7c18ac Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-867655217 Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:30:57.466326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:30:57.467540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/450cacbbb551460198179c4a0c7c18ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_450cacbbb551460198179c4a0c7c18ac", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/450cacbbb551460198179c4a0c7c18ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/450cacbbb551460198179c4a0c7c18ac"}]}] Aug 08 14:30:57.467540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-VolumesSnapshotsTestJSON-867655217 Aug 08 14:30:57.467540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 450cacbbb551460198179c4a0c7c18ac Aug 08 14:30:57.467540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-867655217 Aug 08 14:30:57.467540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-VolumesSnapshotsTestJSON-867655217-project Aug 08 14:30:57.467540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:30:57.467540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:30:57.467540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: a193081e23864453987cd63da6493049 Aug 08 14:30:57.467540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-VolumesSnapshotsTestJSON-867655217-project Aug 08 14:30:57.467540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: Aug 08 14:30:57.467540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:57.467540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': '5e9adad1-0df0-4ace-99c4-cc68ca837b67'} Aug 08 14:30:57.467540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. (HTTP 404) (Request-ID: req-e6d78b6b-beaa-44fc-a72b-b8bd51ee6172) Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:57.468187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 14:30:57.469086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 14:30:57.470261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:30:57.471173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:57.471173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.471173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:57.471173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.471173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:57.471173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:30:57.471173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:30:57.471173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:30:57.471173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:30:57.471173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:57.471173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.476646 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-32d5979b-d70b-40f2-87a0-b0a158c7761f tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Returning 404 to user: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:30:57.476646 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-32d5979b-d70b-40f2-87a0-b0a158c7761f tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67" status: 404 len: 109 microversion: 2.1 time: 0.222137 Aug 08 14:30:57.483940 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 11/25] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 14:30:57 2022] GET /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67 => generated 109 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:30:57.489936 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-927659e0-5582-41e8-87e0-223b5b0b3bfd tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb43a63a0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:57.817064 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-927659e0-5582-41e8-87e0-223b5b0b3bfd tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] HTTP exception thrown: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-927659e0-5582-41e8-87e0-223b5b0b3bfd tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Request method failure captured: Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: DELETE /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67 HTTP/1.1 Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4Uz5FAngHemd95_Cgl0yqnXAe2ZkM4i5ZZO0tm7G2FICdVJiUulyq6ALgref5ZFb58MiRRsmo8A0xkQB4cNRxlQv3dpljaU7GLE7XmeH7gs_ovdVbpbks8-a_b_yg27Tsg8g8kDdpeo6SLP_sINsbxxPsEyaqNT2FbfCGL_yNjXBA Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 450cacbbb551460198179c4a0c7c18ac Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-867655217 Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:30:57.821856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:30:57.823020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/450cacbbb551460198179c4a0c7c18ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_450cacbbb551460198179c4a0c7c18ac", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/450cacbbb551460198179c4a0c7c18ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/450cacbbb551460198179c4a0c7c18ac"}]}] Aug 08 14:30:57.823020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesSnapshotsTestJSON-867655217 Aug 08 14:30:57.823020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 450cacbbb551460198179c4a0c7c18ac Aug 08 14:30:57.823020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-867655217 Aug 08 14:30:57.823020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesSnapshotsTestJSON-867655217-project Aug 08 14:30:57.823020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:30:57.823020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:30:57.823020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: a193081e23864453987cd63da6493049 Aug 08 14:30:57.823020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesSnapshotsTestJSON-867655217-project Aug 08 14:30:57.823020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: Aug 08 14:30:57.823020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:57.823020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '5e9adad1-0df0-4ace-99c4-cc68ca837b67'} Aug 08 14:30:57.823020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. (HTTP 404) (Request-ID: req-96084b5b-a659-45ca-b015-fbb261938372) Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:57.823861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 14:30:57.824760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 14:30:57.825771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:30:57.826629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:57.826629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.826629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:57.826629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.826629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:57.826629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:30:57.826629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:30:57.826629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:30:57.826629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:30:57.826629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:57.826629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:30:57.829213 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-927659e0-5582-41e8-87e0-223b5b0b3bfd tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Returning 404 to user: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:30:57.830298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-927659e0-5582-41e8-87e0-223b5b0b3bfd tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67" status: 404 len: 109 microversion: 2.1 time: 0.345737 Aug 08 14:30:57.831389 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 15/26] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 14:30:57 2022] DELETE /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67 => generated 109 bytes in 347 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:30:57.841655 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1786298d-4e45-4987-9d7d-b4e90a0fcea7 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Calling method '.version_select at 0x7f9cb3a8d670>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:30:58.058701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-1786298d-4e45-4987-9d7d-b4e90a0fcea7 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] HTTP exception thrown: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1786298d-4e45-4987-9d7d-b4e90a0fcea7 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Request method failure captured: Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67 HTTP/1.1 Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4Uz5FAngHemd95_Cgl0yqnXAe2ZkM4i5ZZO0tm7G2FICdVJiUulyq6ALgref5ZFb58MiRRsmo8A0xkQB4cNRxlQv3dpljaU7GLE7XmeH7gs_ovdVbpbks8-a_b_yg27Tsg8g8kDdpeo6SLP_sINsbxxPsEyaqNT2FbfCGL_yNjXBA Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 450cacbbb551460198179c4a0c7c18ac Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-867655217 Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:30:58.061348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:30:58.062579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/450cacbbb551460198179c4a0c7c18ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_450cacbbb551460198179c4a0c7c18ac", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/450cacbbb551460198179c4a0c7c18ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/450cacbbb551460198179c4a0c7c18ac"}]}] Aug 08 14:30:58.062579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-VolumesSnapshotsTestJSON-867655217 Aug 08 14:30:58.062579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 450cacbbb551460198179c4a0c7c18ac Aug 08 14:30:58.062579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-867655217 Aug 08 14:30:58.062579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-VolumesSnapshotsTestJSON-867655217-project Aug 08 14:30:58.062579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:30:58.062579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:30:58.062579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: a193081e23864453987cd63da6493049 Aug 08 14:30:58.062579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-VolumesSnapshotsTestJSON-867655217-project Aug 08 14:30:58.062579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: Aug 08 14:30:58.062579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:58.062579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': '5e9adad1-0df0-4ace-99c4-cc68ca837b67'} Aug 08 14:30:58.062579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. (HTTP 404) (Request-ID: req-e538d8bc-a8d8-4638-8677-0fc073820ff0) Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:58.063238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 14:30:58.064110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 14:30:58.064955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:30:58.065833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:58.065833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:58.065833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:30:58.065833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:58.065833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:30:58.065833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:30:58.065833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:30:58.065833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:30:58.065833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:30:58.065833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. Aug 08 14:30:58.065833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:30:58.068880 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1786298d-4e45-4987-9d7d-b4e90a0fcea7 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] Returning 404 to user: Volume 5e9adad1-0df0-4ace-99c4-cc68ca837b67 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:30:58.070518 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1786298d-4e45-4987-9d7d-b4e90a0fcea7 tempest-VolumesSnapshotsTestJSON-867655217 tempest-VolumesSnapshotsTestJSON-867655217-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67" status: 404 len: 109 microversion: 2.1 time: 0.233684 Aug 08 14:30:58.072680 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 12/27] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 14:30:57 2022] GET /compute/v2.1/os-volumes/5e9adad1-0df0-4ace-99c4-cc68ca837b67 => generated 109 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:31:00.640644 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d644d2ac-40bf-40fa-81c4-fa5c1b7ed015 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Action: 'create', calling method: .version_select at 0x7f9cb43a60d0>, body: {"keypair": {"name": "tempest-keypair-67406348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOpNz+rvAaBD64kDWN692+fEkECPl0lKGkBBbNr7pQwLYqdroBoGP2bxnrc1Gan3vzIlXS5NAChGfsCoiqA+iQ27Hq17mglg4DPX+N5DZU5lvJlYVdTMqPNUqe58tlYfQ=="}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:00.782343 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-d644d2ac-40bf-40fa-81c4-fa5c1b7ed015 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Getting quotas for project 0400861a88074a1480b54ce5e651cc76. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:31:00.801629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-d644d2ac-40bf-40fa-81c4-fa5c1b7ed015 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Getting quotas for user 75b75be070a147fba4788b0f51d8d0fb and project 0400861a88074a1480b54ce5e651cc76. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:31:00.908942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d644d2ac-40bf-40fa-81c4-fa5c1b7ed015 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.564028 Aug 08 14:31:00.909556 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 16/28] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 14:31:00 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:02.779448 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-53470659", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f5f82ef-035c-4c6b-ae6e-53ab04cd7d05"}], "security_groups": [{"name": "tempest-securitygroup--50328048"}], "key_name": "tempest-keypair-564161905", "user_data": "}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:03.306183 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.network.neutron [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] validate_networks() for [('9f5f82ef-035c-4c6b-ae6e-53ab04cd7d05', None, None, None, None, None)] {{(pid=118062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:31:04.123915 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e9a61d0a-42f7-4d3f-87d5-d6ad0141ac6d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Action: 'create', calling method: .version_select at 0x7f9cb42caaf0>, body: {"keypair": {"name": "tempest-keypair-1200180953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA54cQ+Ga1ouGWF8oe30rrN2OPGfq19guG2wBAQ4/Yu7ok+C7392XYGYMIzsWSv5yn+ikJozUZ/QPlS073u4FNSyi5JCnagLLdqPYUQhG/ZoMFf5Cdonr0jtcLeBY9a6fw=="}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:04.187476 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-e9a61d0a-42f7-4d3f-87d5-d6ad0141ac6d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for project cfc86120e53145328dd430f542e73182. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:31:04.204902 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-e9a61d0a-42f7-4d3f-87d5-d6ad0141ac6d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for user 48a91f6797cc4604ba2606e0549234d0 and project cfc86120e53145328dd430f542e73182. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:31:04.296297 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e9a61d0a-42f7-4d3f-87d5-d6ad0141ac6d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.610435 Aug 08 14:31:04.309156 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 17/29] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 14:31:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:05.236237 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-315607796", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "networks": [{"uuid": "307bad23-c900-440f-9460-f2b0069243e2"}]}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:05.418645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] validate_networks() for [('307bad23-c900-440f-9460-f2b0069243e2', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:31:05.535329 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=4 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:31:07.146058 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Flavor limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:31:07.147383 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Image limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:31:07.148024 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Flavor pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:31:07.148869 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Image pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:31:07.149642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:31:07.177514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:07.180716 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:07.182308 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:07.183976 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:07.185475 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:07.192120 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:07.273979 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Getting quotas for project fa2ecaeb6faf4c1ea5eac70b19398b42. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:31:07.285623 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Getting quotas for user 84d2f3c3c5fb4cceabf9a35f64a1551c and project fa2ecaeb6faf4c1ea5eac70b19398b42. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:31:07.329377 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Going to run 1 instances... {{(pid=118062) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:31:07.332833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:31:07.464502 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ec719155-71dd-408d-815b-80e9e7cb4006 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 4.691232 Aug 08 14:31:07.465513 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 13/30] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Aug 8 14:31:02 2022] POST /compute/v2.1/servers => generated 400 bytes in 4693 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 14:31:07.478745 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c3c7ec29-7937-4d8e-bf69-5062fbeadbab tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] Calling method '.version_select at 0x7f9cb3a36430>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:07.674595 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c3c7ec29-7937-4d8e-bf69-5062fbeadbab tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/82328091-b07b-449b-b4a9-ea722265d8ee" status: 200 len: 351 microversion: 2.1 time: 0.207635 Aug 08 14:31:07.677496 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 14/31] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 14:31:07 2022] GET /compute/v2.1/os-volumes/82328091-b07b-449b-b4a9-ea722265d8ee => generated 351 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:07.696324 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bbd2dae4-2274-4540-831f-99fac3c2a24e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:07.699592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bbd2dae4-2274-4540-831f-99fac3c2a24e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:08.014300 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bbd2dae4-2274-4540-831f-99fac3c2a24e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:08.047415 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bbd2dae4-2274-4540-831f-99fac3c2a24e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:08.054572 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bbd2dae4-2274-4540-831f-99fac3c2a24e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:08.056858 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bbd2dae4-2274-4540-831f-99fac3c2a24e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1279 microversion: 2.20 time: 0.371040 Aug 08 14:31:08.060112 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 15/32] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:07 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1279 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:08.073872 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-717137344", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f929f776-61ed-4a69-83e4-c03b4b7011a5"}], "security_groups": [{"name": "tempest-securitygroup--1093971080"}], "key_name": "tempest-keypair-67406348", "user_data": "}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:08.587319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.network.neutron [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] validate_networks() for [('f929f776-61ed-4a69-83e4-c03b4b7011a5', None, None, None, None, None)] {{(pid=118062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:31:08.613183 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:31:08.614175 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:31:08.614175 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:31:08.614608 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:31:08.615032 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:31:08.654398 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:08.655922 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:08.657888 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:08.662950 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:08.663762 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:08.665217 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:08.746269 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Getting quotas for project 82cfe2f487fc4393bda828dc28471dca. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:31:08.757014 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Getting quotas for user 33c71ba6b2ad438d8593fa19eb617a34 and project 82cfe2f487fc4393bda828dc28471dca. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:31:08.797219 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:31:08.813708 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:31:09.008126 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7ecde722-bb85-43d6-8eb5-545997e12c97 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.697437 Aug 08 14:31:09.008996 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 18/33] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:31:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 4699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:31:09.023258 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d84fb031-b7d5-42e6-8a19-93f1b5561218 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:09.024156 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d84fb031-b7d5-42e6-8a19-93f1b5561218 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:09.219068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d84fb031-b7d5-42e6-8a19-93f1b5561218 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:09.243922 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d84fb031-b7d5-42e6-8a19-93f1b5561218 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1214 microversion: 2.1 time: 0.225748 Aug 08 14:31:09.244867 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 19/34] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:09 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1214 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:09.256225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-63dcd81a-eb2e-4889-b35b-1bd5d6317024 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:09.257180 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-63dcd81a-eb2e-4889-b35b-1bd5d6317024 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:09.353904 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-63dcd81a-eb2e-4889-b35b-1bd5d6317024 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:09.363902 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-63dcd81a-eb2e-4889-b35b-1bd5d6317024 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:09.367238 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-63dcd81a-eb2e-4889-b35b-1bd5d6317024 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:09.368577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-63dcd81a-eb2e-4889-b35b-1bd5d6317024 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1279 microversion: 2.20 time: 0.122631 Aug 08 14:31:09.370414 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 20/35] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:09 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1279 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:09.549479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b580f58d-73b6-45d2-9426-516167b76987 tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] Calling method '.version_select at 0x7f9cb29da9d0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:09.703442 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b580f58d-73b6-45d2-9426-516167b76987 tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/40298b41-f4ce-4ba3-8e85-22cc69661a4e" status: 200 len: 351 microversion: 2.1 time: 0.158284 Aug 08 14:31:09.715612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 21/36] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 14:31:09 2022] GET /compute/v2.1/os-volumes/40298b41-f4ce-4ba3-8e85-22cc69661a4e => generated 351 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:09.745437 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1344601679", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fc22420-3005-4d46-a261-c4b4ae68cba2"}], "security_groups": [{"name": "tempest-securitygroup--1617493795"}], "key_name": "tempest-keypair-1200180953", "user_data": "}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:09.777667 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Flavor limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:31:09.778575 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Image limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:31:09.779609 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Flavor pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:31:09.780425 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Image pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:31:09.782154 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:31:09.814724 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:09.817998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:09.820380 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:09.827820 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:09.831044 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:09.833554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:09.900320 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Getting quotas for project 0400861a88074a1480b54ce5e651cc76. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:31:09.911209 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Getting quotas for user 75b75be070a147fba4788b0f51d8d0fb and project 0400861a88074a1480b54ce5e651cc76. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:31:09.940450 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Going to run 1 instances... {{(pid=118062) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:31:09.952648 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:31:09.962987 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] validate_networks() for [('3fc22420-3005-4d46-a261-c4b4ae68cba2', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:31:10.174468 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7283ef51-6805-4bb6-ab9e-4e4eabf68b3c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.086399 Aug 08 14:31:10.176943 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 16/37] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:31:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 2116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:31:10.190850 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f1d8acee-87e0-4aa9-bd75-582f8466c723 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:10.192097 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f1d8acee-87e0-4aa9-bd75-582f8466c723 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:10.498163 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f1d8acee-87e0-4aa9-bd75-582f8466c723 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:10.517963 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f1d8acee-87e0-4aa9-bd75-582f8466c723 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1235 microversion: 2.1 time: 0.334673 Aug 08 14:31:10.524753 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 17/38] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:10 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1235 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:31:10.534810 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c50b4bc9-5c47-42d3-ba8c-d1268bff26b2 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:10.542799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c50b4bc9-5c47-42d3-ba8c-d1268bff26b2 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:11.241915 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c50b4bc9-5c47-42d3-ba8c-d1268bff26b2 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:11.263386 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c50b4bc9-5c47-42d3-ba8c-d1268bff26b2 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1214 microversion: 2.1 time: 0.730580 Aug 08 14:31:11.266634 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 18/39] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:10 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1214 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:11.280218 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-45bf1862-ab69-4e57-9214-31675b030997 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:11.281756 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-45bf1862-ab69-4e57-9214-31675b030997 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:11.331368 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45bf1862-ab69-4e57-9214-31675b030997 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:11.332136 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45bf1862-ab69-4e57-9214-31675b030997 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:11.332749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45bf1862-ab69-4e57-9214-31675b030997 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:11.334237 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45bf1862-ab69-4e57-9214-31675b030997 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:11.335409 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45bf1862-ab69-4e57-9214-31675b030997 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:11.336006 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45bf1862-ab69-4e57-9214-31675b030997 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:11.644044 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-45bf1862-ab69-4e57-9214-31675b030997 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:11.673723 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-45bf1862-ab69-4e57-9214-31675b030997 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:11.681053 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-45bf1862-ab69-4e57-9214-31675b030997 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:11.681361 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-45bf1862-ab69-4e57-9214-31675b030997 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1331 microversion: 2.20 time: 0.412895 Aug 08 14:31:11.685459 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 19/40] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:11 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1331 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:11.696361 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-36cba81e-cdb8-46d7-acf3-0f7f29874a19 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:11.698323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-36cba81e-cdb8-46d7-acf3-0f7f29874a19 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:11.717419 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-36cba81e-cdb8-46d7-acf3-0f7f29874a19 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:11.718833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-36cba81e-cdb8-46d7-acf3-0f7f29874a19 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:11.722861 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-36cba81e-cdb8-46d7-acf3-0f7f29874a19 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:11.723779 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-36cba81e-cdb8-46d7-acf3-0f7f29874a19 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:11.724399 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-36cba81e-cdb8-46d7-acf3-0f7f29874a19 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:11.725020 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-36cba81e-cdb8-46d7-acf3-0f7f29874a19 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:11.738248 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:31:11.738775 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:31:11.739374 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:31:11.739798 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:31:11.740328 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:31:11.757494 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:11.758009 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:11.758536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:11.759247 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:11.763838 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:11.764511 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:11.819610 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for project cfc86120e53145328dd430f542e73182. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:31:11.823965 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for user 48a91f6797cc4604ba2606e0549234d0 and project cfc86120e53145328dd430f542e73182. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:31:11.844771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:31:11.847848 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:31:11.911994 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-36cba81e-cdb8-46d7-acf3-0f7f29874a19 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:11.934552 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-36cba81e-cdb8-46d7-acf3-0f7f29874a19 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1239 microversion: 2.1 time: 0.247932 Aug 08 14:31:11.972185 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 20/41] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:11 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1239 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:11.987481 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8c4d196f-9c27-4c6b-8b0c-4a5097b84a9f tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] Calling method '.version_select at 0x7f9cb2926f70>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:11.997478 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1160cf8b-69b9-4d95-8333-366b0bdb2678 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.257163 Aug 08 14:31:12.004595 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 22/42] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:31:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 2265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 14:31:12.034863 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c8d396a2-66b9-4d3f-9679-d546f91014e4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:12.042595 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c8d396a2-66b9-4d3f-9679-d546f91014e4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:12.152012 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8c4d196f-9c27-4c6b-8b0c-4a5097b84a9f tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/49b044a1-1d79-4388-bcea-28095b065e08" status: 200 len: 351 microversion: 2.1 time: 0.177157 Aug 08 14:31:12.160292 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 21/43] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 14:31:11 2022] GET /compute/v2.1/os-volumes/49b044a1-1d79-4388-bcea-28095b065e08 => generated 351 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:12.169002 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a7997869-1b81-40da-bbe1-b4563ddb4ec1 tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] Calling method '.version_select at 0x7f9cb295eca0>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:12.177196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c8d396a2-66b9-4d3f-9679-d546f91014e4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:12.186053 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c8d396a2-66b9-4d3f-9679-d546f91014e4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1242 microversion: 2.1 time: 0.166490 Aug 08 14:31:12.188383 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 23/44] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:12 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1242 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:12.293532 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c5f27362-9b62-4244-ab50-60745092d0f3 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:12.294167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c5f27362-9b62-4244-ab50-60745092d0f3 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:12.305685 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c5f27362-9b62-4244-ab50-60745092d0f3 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:12.314507 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c5f27362-9b62-4244-ab50-60745092d0f3 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:12.314967 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c5f27362-9b62-4244-ab50-60745092d0f3 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:12.315745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c5f27362-9b62-4244-ab50-60745092d0f3 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:12.319868 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c5f27362-9b62-4244-ab50-60745092d0f3 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:12.320327 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c5f27362-9b62-4244-ab50-60745092d0f3 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:12.378611 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-a7997869-1b81-40da-bbe1-b4563ddb4ec1 tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.216956 Aug 08 14:31:12.379573 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 22/45] 10.222.0.50 () {58 vars in 1134 bytes} [Mon Aug 8 14:31:12 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:31:12.395495 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-33705850-7ce1-49b0-b869-4346836deba8 tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] Calling method '.version_select at 0x7f9cb28dc1f0>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:12.760716 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-33705850-7ce1-49b0-b869-4346836deba8 tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.371110 Aug 08 14:31:12.761637 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 23/46] 10.222.0.50 () {58 vars in 1149 bytes} [Mon Aug 8 14:31:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:31:12.766985 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-14c07f5f-5a52-4b03-be1f-e23956a20674 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:12.767846 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-14c07f5f-5a52-4b03-be1f-e23956a20674 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:12.804106 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-14c07f5f-5a52-4b03-be1f-e23956a20674 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:12.805998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-14c07f5f-5a52-4b03-be1f-e23956a20674 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:12.807032 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-14c07f5f-5a52-4b03-be1f-e23956a20674 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:12.809099 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-14c07f5f-5a52-4b03-be1f-e23956a20674 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:12.810479 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-14c07f5f-5a52-4b03-be1f-e23956a20674 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:12.811541 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-14c07f5f-5a52-4b03-be1f-e23956a20674 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:12.944933 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c5f27362-9b62-4244-ab50-60745092d0f3 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:12.967614 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c5f27362-9b62-4244-ab50-60745092d0f3 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1274 microversion: 2.1 time: 0.678046 Aug 08 14:31:12.984961 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 24/47] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:12 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1274 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:12.993626 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-34646092-e926-4615-b665-27a6162d7e67 tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] Calling method '.version_select at 0x7f9cb3a84430>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:13.038507 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-14c07f5f-5a52-4b03-be1f-e23956a20674 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:13.087343 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-14c07f5f-5a52-4b03-be1f-e23956a20674 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:13.089010 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-14c07f5f-5a52-4b03-be1f-e23956a20674 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:13.090178 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-14c07f5f-5a52-4b03-be1f-e23956a20674 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1337 microversion: 2.20 time: 0.327474 Aug 08 14:31:13.105418 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 24/48] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:12 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1337 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:13.118307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4eb27d32-fb24-4398-95d7-f4f9bebfa33c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:13.125500 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-4eb27d32-fb24-4398-95d7-f4f9bebfa33c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:13.164617 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4eb27d32-fb24-4398-95d7-f4f9bebfa33c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:13.167627 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4eb27d32-fb24-4398-95d7-f4f9bebfa33c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:13.173271 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4eb27d32-fb24-4398-95d7-f4f9bebfa33c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:13.176150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4eb27d32-fb24-4398-95d7-f4f9bebfa33c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:13.177093 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4eb27d32-fb24-4398-95d7-f4f9bebfa33c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:13.177538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4eb27d32-fb24-4398-95d7-f4f9bebfa33c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:13.240081 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-34646092-e926-4615-b665-27a6162d7e67 tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.253776 Aug 08 14:31:13.240713 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 25/49] 10.222.0.50 () {58 vars in 1134 bytes} [Mon Aug 8 14:31:12 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:13.246383 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b073be8e-6857-4049-b03c-0a6b2f33c066 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:13.246995 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b073be8e-6857-4049-b03c-0a6b2f33c066 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:13.506842 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b073be8e-6857-4049-b03c-0a6b2f33c066 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:13.518601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b073be8e-6857-4049-b03c-0a6b2f33c066 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1242 microversion: 2.1 time: 0.275490 Aug 08 14:31:13.527941 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 26/50] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:13 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1242 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:13.550994 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-dfced46d-9a10-4b8d-85bc-fe8f1e33613e tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] Calling method '.version_select at 0x7f9cb2973b80>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:13.864510 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-dfced46d-9a10-4b8d-85bc-fe8f1e33613e tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.334921 Aug 08 14:31:13.865449 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 27/51] 10.222.0.50 () {58 vars in 1167 bytes} [Mon Aug 8 14:31:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:13.882078 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4eb27d32-fb24-4398-95d7-f4f9bebfa33c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:13.884878 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bb32ad4c-fb00-4388-b959-b5a44a4a37dc tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] Calling method '.version_select at 0x7f9cb292f310>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:13.894226 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-4eb27d32-fb24-4398-95d7-f4f9bebfa33c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1287 microversion: 2.1 time: 0.786033 Aug 08 14:31:13.894815 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 25/52] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:13 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1287 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:13.998795 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c11b5850-67f0-41a4-b0ba-19221c35ec39 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:13.999946 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c11b5850-67f0-41a4-b0ba-19221c35ec39 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:14.010062 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c11b5850-67f0-41a4-b0ba-19221c35ec39 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:14.013404 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c11b5850-67f0-41a4-b0ba-19221c35ec39 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:14.014071 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c11b5850-67f0-41a4-b0ba-19221c35ec39 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:14.015029 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c11b5850-67f0-41a4-b0ba-19221c35ec39 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:14.015847 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c11b5850-67f0-41a4-b0ba-19221c35ec39 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:14.016488 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c11b5850-67f0-41a4-b0ba-19221c35ec39 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:14.092983 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bb32ad4c-fb00-4388-b959-b5a44a4a37dc tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.217583 Aug 08 14:31:14.093877 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 28/53] 10.222.0.50 () {58 vars in 1170 bytes} [Mon Aug 8 14:31:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:31:14.107600 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9156201a-bcc5-46d7-95ce-8c4528cb53f2 tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] Calling method '.version_select at 0x7f9cb292fd30>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:14.206607 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c11b5850-67f0-41a4-b0ba-19221c35ec39 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:14.220270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c11b5850-67f0-41a4-b0ba-19221c35ec39 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1272 microversion: 2.1 time: 0.226495 Aug 08 14:31:14.220885 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 26/54] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:13 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:31:14.235758 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6d3d9ddb-e87f-4335-a27d-142ce21fac88 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:14.236391 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6d3d9ddb-e87f-4335-a27d-142ce21fac88 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:14.267466 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d3d9ddb-e87f-4335-a27d-142ce21fac88 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:14.268614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d3d9ddb-e87f-4335-a27d-142ce21fac88 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:14.271665 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d3d9ddb-e87f-4335-a27d-142ce21fac88 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:14.273216 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d3d9ddb-e87f-4335-a27d-142ce21fac88 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:14.273836 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d3d9ddb-e87f-4335-a27d-142ce21fac88 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:14.274436 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d3d9ddb-e87f-4335-a27d-142ce21fac88 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:14.312358 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9156201a-bcc5-46d7-95ce-8c4528cb53f2 tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.208616 Aug 08 14:31:14.312935 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 29/55] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Aug 8 14:31:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:31:14.326357 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b9cc06d5-2865-4394-97fe-0b7f955fecb7 tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] Calling method '.version_select at 0x7f9cb29739d0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:14.586048 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b9cc06d5-2865-4394-97fe-0b7f955fecb7 tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.263611 Aug 08 14:31:14.587696 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 30/56] 10.222.0.50 () {58 vars in 1188 bytes} [Mon Aug 8 14:31:14 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:14.594271 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-caa6ebf4-9d4e-41e1-860f-c591d6460e2d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:14.595150 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-caa6ebf4-9d4e-41e1-860f-c591d6460e2d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:14.623485 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caa6ebf4-9d4e-41e1-860f-c591d6460e2d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:14.624865 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caa6ebf4-9d4e-41e1-860f-c591d6460e2d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:14.625558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caa6ebf4-9d4e-41e1-860f-c591d6460e2d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:14.627057 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caa6ebf4-9d4e-41e1-860f-c591d6460e2d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:14.627694 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caa6ebf4-9d4e-41e1-860f-c591d6460e2d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:14.628301 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caa6ebf4-9d4e-41e1-860f-c591d6460e2d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:14.865830 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6d3d9ddb-e87f-4335-a27d-142ce21fac88 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:14.879420 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6d3d9ddb-e87f-4335-a27d-142ce21fac88 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:14.886140 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6d3d9ddb-e87f-4335-a27d-142ce21fac88 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:14.895830 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6d3d9ddb-e87f-4335-a27d-142ce21fac88 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1337 microversion: 2.20 time: 0.669139 Aug 08 14:31:14.896477 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 27/57] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:14 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1337 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:14.929505 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d61eaab2-5cbe-42c7-9a5d-88388ade6705 tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] Calling method '.version_select at 0x7f9cb28dc8b0>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:15.141575 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d61eaab2-5cbe-42c7-9a5d-88388ade6705 tempest-VolumesTestJSON-612432487 tempest-VolumesTestJSON-612432487-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.236990 Aug 08 14:31:15.156183 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 28/58] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Aug 8 14:31:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:15.166834 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-908534bc-fca5-47dc-9b8c-1cc8c9f46be6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:15.167820 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-908534bc-fca5-47dc-9b8c-1cc8c9f46be6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:15.183963 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-908534bc-fca5-47dc-9b8c-1cc8c9f46be6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:15.184683 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-908534bc-fca5-47dc-9b8c-1cc8c9f46be6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:15.187509 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-908534bc-fca5-47dc-9b8c-1cc8c9f46be6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:15.188497 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-908534bc-fca5-47dc-9b8c-1cc8c9f46be6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:15.190338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-908534bc-fca5-47dc-9b8c-1cc8c9f46be6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:15.191006 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-908534bc-fca5-47dc-9b8c-1cc8c9f46be6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:15.528251 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-caa6ebf4-9d4e-41e1-860f-c591d6460e2d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:15.545424 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-caa6ebf4-9d4e-41e1-860f-c591d6460e2d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1312 microversion: 2.1 time: 0.954416 Aug 08 14:31:15.547503 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 31/59] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:14 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1312 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:15.563477 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-60ed5305-1fd6-424d-aee3-31e5d7c63b20 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:15.564377 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-60ed5305-1fd6-424d-aee3-31e5d7c63b20 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:15.597492 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60ed5305-1fd6-424d-aee3-31e5d7c63b20 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:15.597845 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60ed5305-1fd6-424d-aee3-31e5d7c63b20 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:15.598683 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60ed5305-1fd6-424d-aee3-31e5d7c63b20 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:15.599672 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60ed5305-1fd6-424d-aee3-31e5d7c63b20 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:15.601970 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60ed5305-1fd6-424d-aee3-31e5d7c63b20 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:15.602611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60ed5305-1fd6-424d-aee3-31e5d7c63b20 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:15.624408 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-908534bc-fca5-47dc-9b8c-1cc8c9f46be6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:15.634862 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-908534bc-fca5-47dc-9b8c-1cc8c9f46be6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1293 microversion: 2.1 time: 0.477271 Aug 08 14:31:15.656473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 29/60] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:15 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1293 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:15.925068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4022b04a-ee54-4ba2-8625-cc2b081bc486 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:15.925730 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-4022b04a-ee54-4ba2-8625-cc2b081bc486 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:15.938376 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4022b04a-ee54-4ba2-8625-cc2b081bc486 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:15.938871 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4022b04a-ee54-4ba2-8625-cc2b081bc486 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:15.945430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4022b04a-ee54-4ba2-8625-cc2b081bc486 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:15.949599 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4022b04a-ee54-4ba2-8625-cc2b081bc486 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:15.951712 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4022b04a-ee54-4ba2-8625-cc2b081bc486 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:15.953124 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4022b04a-ee54-4ba2-8625-cc2b081bc486 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:16.188996 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-60ed5305-1fd6-424d-aee3-31e5d7c63b20 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:16.208193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-60ed5305-1fd6-424d-aee3-31e5d7c63b20 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1272 microversion: 2.1 time: 0.653954 Aug 08 14:31:16.209203 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 32/61] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:15 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1272 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:16.572829 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8e9d0e7a-5f89-4e8c-81bc-3a9489961432 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:16.574435 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8e9d0e7a-5f89-4e8c-81bc-3a9489961432 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:16.587216 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e9d0e7a-5f89-4e8c-81bc-3a9489961432 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:16.588362 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e9d0e7a-5f89-4e8c-81bc-3a9489961432 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:16.589039 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e9d0e7a-5f89-4e8c-81bc-3a9489961432 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:16.592148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e9d0e7a-5f89-4e8c-81bc-3a9489961432 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:16.593025 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e9d0e7a-5f89-4e8c-81bc-3a9489961432 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:16.595814 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e9d0e7a-5f89-4e8c-81bc-3a9489961432 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:17.872754 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4022b04a-ee54-4ba2-8625-cc2b081bc486 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:17.899158 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4022b04a-ee54-4ba2-8625-cc2b081bc486 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:17.910754 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4022b04a-ee54-4ba2-8625-cc2b081bc486 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:17.912363 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-4022b04a-ee54-4ba2-8625-cc2b081bc486 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 1.992419 Aug 08 14:31:17.916469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 30/62] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:15 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:17.947952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-59fcbf07-fcc8-42ed-a8fc-651ac98b4bae tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:17.955671 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-59fcbf07-fcc8-42ed-a8fc-651ac98b4bae tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:17.970016 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59fcbf07-fcc8-42ed-a8fc-651ac98b4bae tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:17.972080 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59fcbf07-fcc8-42ed-a8fc-651ac98b4bae tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:17.972771 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59fcbf07-fcc8-42ed-a8fc-651ac98b4bae tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:17.973704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59fcbf07-fcc8-42ed-a8fc-651ac98b4bae tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:17.975562 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59fcbf07-fcc8-42ed-a8fc-651ac98b4bae tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:17.978042 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59fcbf07-fcc8-42ed-a8fc-651ac98b4bae tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:18.003733 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8e9d0e7a-5f89-4e8c-81bc-3a9489961432 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:18.023693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8e9d0e7a-5f89-4e8c-81bc-3a9489961432 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 1.456190 Aug 08 14:31:18.027459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 33/63] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:16 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:18.036503 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e2284cf8-0d2b-4e60-abc3-7e3cdf6b82ba tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:18.038909 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e2284cf8-0d2b-4e60-abc3-7e3cdf6b82ba tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:18.058926 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e2284cf8-0d2b-4e60-abc3-7e3cdf6b82ba tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:18.060344 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e2284cf8-0d2b-4e60-abc3-7e3cdf6b82ba tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:18.061174 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e2284cf8-0d2b-4e60-abc3-7e3cdf6b82ba tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:18.062118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e2284cf8-0d2b-4e60-abc3-7e3cdf6b82ba tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:18.062773 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e2284cf8-0d2b-4e60-abc3-7e3cdf6b82ba tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:18.078066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e2284cf8-0d2b-4e60-abc3-7e3cdf6b82ba tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:18.514588 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-59fcbf07-fcc8-42ed-a8fc-651ac98b4bae tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:18.529291 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-59fcbf07-fcc8-42ed-a8fc-651ac98b4bae tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1293 microversion: 2.1 time: 0.611355 Aug 08 14:31:18.530159 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 31/64] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:17 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1293 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:18.948023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2fbdad6e-1669-4c07-8828-02c5d0f35cf2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:18.948895 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2fbdad6e-1669-4c07-8828-02c5d0f35cf2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:18.960212 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fbdad6e-1669-4c07-8828-02c5d0f35cf2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:18.960705 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fbdad6e-1669-4c07-8828-02c5d0f35cf2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:18.961154 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fbdad6e-1669-4c07-8828-02c5d0f35cf2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:18.969345 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fbdad6e-1669-4c07-8828-02c5d0f35cf2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:18.970113 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fbdad6e-1669-4c07-8828-02c5d0f35cf2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:18.970643 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fbdad6e-1669-4c07-8828-02c5d0f35cf2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:19.628553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2fbdad6e-1669-4c07-8828-02c5d0f35cf2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:19.640193 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2fbdad6e-1669-4c07-8828-02c5d0f35cf2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:19.650341 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2fbdad6e-1669-4c07-8828-02c5d0f35cf2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:19.654043 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2fbdad6e-1669-4c07-8828-02c5d0f35cf2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.711290 Aug 08 14:31:19.654999 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 32/65] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:18 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:31:19.678325 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-cce32cae-daea-402a-a390-6e58bfffa81e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:19.681000 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-cce32cae-daea-402a-a390-6e58bfffa81e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:19.702037 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cce32cae-daea-402a-a390-6e58bfffa81e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:19.705009 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cce32cae-daea-402a-a390-6e58bfffa81e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:19.705626 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cce32cae-daea-402a-a390-6e58bfffa81e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:19.706505 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cce32cae-daea-402a-a390-6e58bfffa81e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:19.707143 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cce32cae-daea-402a-a390-6e58bfffa81e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:19.712381 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cce32cae-daea-402a-a390-6e58bfffa81e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:19.734003 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e2284cf8-0d2b-4e60-abc3-7e3cdf6b82ba tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:19.750329 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e2284cf8-0d2b-4e60-abc3-7e3cdf6b82ba tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 1.719896 Aug 08 14:31:19.753421 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 34/66] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:18 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:19.773850 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c77fa330-21df-47f2-a4b3-6e2446b40e98 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:19.774936 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c77fa330-21df-47f2-a4b3-6e2446b40e98 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:19.791080 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c77fa330-21df-47f2-a4b3-6e2446b40e98 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:19.791754 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c77fa330-21df-47f2-a4b3-6e2446b40e98 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:19.792863 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c77fa330-21df-47f2-a4b3-6e2446b40e98 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:19.793983 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c77fa330-21df-47f2-a4b3-6e2446b40e98 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:19.794670 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c77fa330-21df-47f2-a4b3-6e2446b40e98 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:19.795653 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c77fa330-21df-47f2-a4b3-6e2446b40e98 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:19.871584 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=4 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:31:21.253030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=18 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:31:21.297828 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-cce32cae-daea-402a-a390-6e58bfffa81e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:21.319438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c77fa330-21df-47f2-a4b3-6e2446b40e98 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:21.332727 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c77fa330-21df-47f2-a4b3-6e2446b40e98 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 1.574035 Aug 08 14:31:21.335385 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 35/67] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:19 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:21.339854 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-cce32cae-daea-402a-a390-6e58bfffa81e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 1.678319 Aug 08 14:31:21.343718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 33/68] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:19 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:21.347987 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2122293f-4f75-4423-8b91-c480defefd44 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:21.351429 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2122293f-4f75-4423-8b91-c480defefd44 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:21.363132 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2122293f-4f75-4423-8b91-c480defefd44 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:21.363668 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2122293f-4f75-4423-8b91-c480defefd44 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:21.364062 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2122293f-4f75-4423-8b91-c480defefd44 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:21.364774 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2122293f-4f75-4423-8b91-c480defefd44 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:21.371579 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2122293f-4f75-4423-8b91-c480defefd44 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:21.372073 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2122293f-4f75-4423-8b91-c480defefd44 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:21.376232 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6000a69e-473e-40de-ac27-2f2c07c903e1 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:21.379012 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6000a69e-473e-40de-ac27-2f2c07c903e1 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:21.407767 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6000a69e-473e-40de-ac27-2f2c07c903e1 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:21.409594 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6000a69e-473e-40de-ac27-2f2c07c903e1 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:21.412761 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6000a69e-473e-40de-ac27-2f2c07c903e1 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:21.417458 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6000a69e-473e-40de-ac27-2f2c07c903e1 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:21.418484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6000a69e-473e-40de-ac27-2f2c07c903e1 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:21.420038 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6000a69e-473e-40de-ac27-2f2c07c903e1 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:21.817971 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=4 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:31:22.864576 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6000a69e-473e-40de-ac27-2f2c07c903e1 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:22.885040 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6000a69e-473e-40de-ac27-2f2c07c903e1 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 1.536236 Aug 08 14:31:22.887961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 34/69] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:21 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:23.115462 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2122293f-4f75-4423-8b91-c480defefd44 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:23.127688 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2122293f-4f75-4423-8b91-c480defefd44 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:23.140071 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2122293f-4f75-4423-8b91-c480defefd44 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:23.141268 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2122293f-4f75-4423-8b91-c480defefd44 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 1.804887 Aug 08 14:31:23.142109 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 36/70] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:21 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:23.310212 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-e0d9cc50-f404-428f-8678-b29bbb54b096 req-85f898b0-b0cb-4855-8ccb-a8f0a7ebec9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70", "tag": "18cae069-68b0-4e95-807f-a1cd956485f8"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:23.345372 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-e0d9cc50-f404-428f-8678-b29bbb54b096 req-85f898b0-b0cb-4855-8ccb-a8f0a7ebec9c service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:23.345656 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-e0d9cc50-f404-428f-8678-b29bbb54b096 req-85f898b0-b0cb-4855-8ccb-a8f0a7ebec9c service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:23.348373 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-e0d9cc50-f404-428f-8678-b29bbb54b096 req-85f898b0-b0cb-4855-8ccb-a8f0a7ebec9c service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:23.408511 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-e0d9cc50-f404-428f-8678-b29bbb54b096 req-85f898b0-b0cb-4855-8ccb-a8f0a7ebec9c service nova] Creating event network-changed:18cae069-68b0-4e95-807f-a1cd956485f8 for instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 on hv-cinder-85200 Aug 08 14:31:23.409770 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-e0d9cc50-f404-428f-8678-b29bbb54b096 req-85f898b0-b0cb-4855-8ccb-a8f0a7ebec9c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118062) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 14:31:23.410177 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-e0d9cc50-f404-428f-8678-b29bbb54b096 req-85f898b0-b0cb-4855-8ccb-a8f0a7ebec9c service nova] Acquired lock "compute-rpcapi-router" {{(pid=118062) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 14:31:23.411327 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f60b4661-de9e-48f4-b945-bacf1544b046 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:23.415683 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f60b4661-de9e-48f4-b945-bacf1544b046 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:23.418148 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f60b4661-de9e-48f4-b945-bacf1544b046 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:23.419225 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f60b4661-de9e-48f4-b945-bacf1544b046 None None] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:23.421454 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f60b4661-de9e-48f4-b945-bacf1544b046 None None] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:23.422755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f60b4661-de9e-48f4-b945-bacf1544b046 None None] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:23.453432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.compute.rpcapi [None req-f60b4661-de9e-48f4-b945-bacf1544b046 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 14:31:23.455522 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f60b4661-de9e-48f4-b945-bacf1544b046 None None] Releasing lock "compute-rpcapi-router" {{(pid=118062) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 14:31:23.480015 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-985a0eb9-e837-47d0-9b1b-f1e435a2a4ce req-b9b3d837-2154-44aa-a969-82786db5eed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd0ce81-8365-4812-b309-d3d873311c3a", "tag": "496b1c03-1e52-4f57-bbae-16f42a9a9f5c"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:23.503715 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-985a0eb9-e837-47d0-9b1b-f1e435a2a4ce req-b9b3d837-2154-44aa-a969-82786db5eed6 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:23.504101 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-985a0eb9-e837-47d0-9b1b-f1e435a2a4ce req-b9b3d837-2154-44aa-a969-82786db5eed6 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:23.506615 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-985a0eb9-e837-47d0-9b1b-f1e435a2a4ce req-b9b3d837-2154-44aa-a969-82786db5eed6 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:23.511353 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f60b4661-de9e-48f4-b945-bacf1544b046 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.618821 Aug 08 14:31:23.512010 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 35/71] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:23.517739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8df317c5-516a-498a-8a9a-6be98b86b758 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:23.520090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8df317c5-516a-498a-8a9a-6be98b86b758 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:23.536063 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8df317c5-516a-498a-8a9a-6be98b86b758 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:23.537055 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8df317c5-516a-498a-8a9a-6be98b86b758 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:23.539126 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8df317c5-516a-498a-8a9a-6be98b86b758 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:23.541584 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8df317c5-516a-498a-8a9a-6be98b86b758 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:23.542329 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8df317c5-516a-498a-8a9a-6be98b86b758 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:23.545526 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8df317c5-516a-498a-8a9a-6be98b86b758 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:23.546255 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=28 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:31:23.574655 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-985a0eb9-e837-47d0-9b1b-f1e435a2a4ce req-b9b3d837-2154-44aa-a969-82786db5eed6 service nova] Creating event network-changed:496b1c03-1e52-4f57-bbae-16f42a9a9f5c for instance fdd0ce81-8365-4812-b309-d3d873311c3a on hv-cinder-85200 Aug 08 14:31:23.575220 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-985a0eb9-e837-47d0-9b1b-f1e435a2a4ce req-b9b3d837-2154-44aa-a969-82786db5eed6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 14:31:23.590812 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-985a0eb9-e837-47d0-9b1b-f1e435a2a4ce req-b9b3d837-2154-44aa-a969-82786db5eed6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 14:31:23.592006 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d758cf0c-7bc3-43d9-b1b1-6bee62b26fd5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:23.592486 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d758cf0c-7bc3-43d9-b1b1-6bee62b26fd5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:23.592919 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d758cf0c-7bc3-43d9-b1b1-6bee62b26fd5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:23.595130 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d758cf0c-7bc3-43d9-b1b1-6bee62b26fd5 None None] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:23.595593 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d758cf0c-7bc3-43d9-b1b1-6bee62b26fd5 None None] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:23.598603 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d758cf0c-7bc3-43d9-b1b1-6bee62b26fd5 None None] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:23.616610 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.compute.rpcapi [None req-d758cf0c-7bc3-43d9-b1b1-6bee62b26fd5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 14:31:23.636347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d758cf0c-7bc3-43d9-b1b1-6bee62b26fd5 None None] Releasing lock "compute-rpcapi-router" {{(pid=118060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 14:31:23.688068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d758cf0c-7bc3-43d9-b1b1-6bee62b26fd5 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.544719 Aug 08 14:31:23.689014 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 37/72] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:23.695132 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-445060d7-9e8f-4014-b544-66846e772d8d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:23.695858 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-445060d7-9e8f-4014-b544-66846e772d8d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:23.727702 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-445060d7-9e8f-4014-b544-66846e772d8d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:23.728300 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-445060d7-9e8f-4014-b544-66846e772d8d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:23.729610 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-445060d7-9e8f-4014-b544-66846e772d8d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:23.732779 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-445060d7-9e8f-4014-b544-66846e772d8d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:23.734106 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-445060d7-9e8f-4014-b544-66846e772d8d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:23.741818 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-445060d7-9e8f-4014-b544-66846e772d8d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:24.711929 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8df317c5-516a-498a-8a9a-6be98b86b758 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:24.724682 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8df317c5-516a-498a-8a9a-6be98b86b758 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 1.211144 Aug 08 14:31:24.725529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 36/73] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:23 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:24.749016 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-99afdf41-1db4-46d6-b2bb-feed39fb1878 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:24.753530 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-99afdf41-1db4-46d6-b2bb-feed39fb1878 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:24.782634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-445060d7-9e8f-4014-b544-66846e772d8d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:24.790224 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-445060d7-9e8f-4014-b544-66846e772d8d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 1.099698 Aug 08 14:31:24.790798 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 38/74] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:23 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:24.799965 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:31:24.812488 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-cbacf918-9ae2-4607-91ca-f36374688e31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:24.816361 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-99afdf41-1db4-46d6-b2bb-feed39fb1878 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:24.821626 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-99afdf41-1db4-46d6-b2bb-feed39fb1878 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:24.822303 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-99afdf41-1db4-46d6-b2bb-feed39fb1878 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:24.823270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-99afdf41-1db4-46d6-b2bb-feed39fb1878 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:24.824225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-cbacf918-9ae2-4607-91ca-f36374688e31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:24.824880 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-99afdf41-1db4-46d6-b2bb-feed39fb1878 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:24.827376 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-99afdf41-1db4-46d6-b2bb-feed39fb1878 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:24.844342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbacf918-9ae2-4607-91ca-f36374688e31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:24.851858 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbacf918-9ae2-4607-91ca-f36374688e31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:24.852530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbacf918-9ae2-4607-91ca-f36374688e31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:24.853083 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbacf918-9ae2-4607-91ca-f36374688e31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:24.853544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbacf918-9ae2-4607-91ca-f36374688e31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:24.853980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbacf918-9ae2-4607-91ca-f36374688e31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:26.033322 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-99afdf41-1db4-46d6-b2bb-feed39fb1878 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:26.058983 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-cbacf918-9ae2-4607-91ca-f36374688e31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:26.068034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-99afdf41-1db4-46d6-b2bb-feed39fb1878 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 1.323634 Aug 08 14:31:26.086208 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-cbacf918-9ae2-4607-91ca-f36374688e31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:26.088208 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-cbacf918-9ae2-4607-91ca-f36374688e31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:26.092329 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 37/75] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:24 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:26.104105 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-11d2be9b-0431-4b3f-a779-0715a1d2de6e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:26.105221 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-11d2be9b-0431-4b3f-a779-0715a1d2de6e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:26.105341 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-cbacf918-9ae2-4607-91ca-f36374688e31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 1.296602 Aug 08 14:31:26.108028 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 39/76] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:24 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:26.123076 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11d2be9b-0431-4b3f-a779-0715a1d2de6e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:26.123076 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11d2be9b-0431-4b3f-a779-0715a1d2de6e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:26.123076 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11d2be9b-0431-4b3f-a779-0715a1d2de6e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:26.123076 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11d2be9b-0431-4b3f-a779-0715a1d2de6e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:26.123474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11d2be9b-0431-4b3f-a779-0715a1d2de6e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:26.123474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11d2be9b-0431-4b3f-a779-0715a1d2de6e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:26.131473 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8090b6f7-6cb0-4991-8c0e-0f8b2e84d69e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:26.137622 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8090b6f7-6cb0-4991-8c0e-0f8b2e84d69e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:26.146185 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:31:26.175418 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8090b6f7-6cb0-4991-8c0e-0f8b2e84d69e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:26.177367 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8090b6f7-6cb0-4991-8c0e-0f8b2e84d69e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:26.179781 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8090b6f7-6cb0-4991-8c0e-0f8b2e84d69e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:26.181214 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8090b6f7-6cb0-4991-8c0e-0f8b2e84d69e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:26.187076 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8090b6f7-6cb0-4991-8c0e-0f8b2e84d69e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:26.188333 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8090b6f7-6cb0-4991-8c0e-0f8b2e84d69e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:26.750914 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8090b6f7-6cb0-4991-8c0e-0f8b2e84d69e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:26.760212 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8090b6f7-6cb0-4991-8c0e-0f8b2e84d69e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.650984 Aug 08 14:31:26.773296 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 40/77] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:26 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:26.788255 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-1d4f9faf-7340-4490-9656-d7ffe03c34a4 req-613ddf6a-29d7-45e6-ab2f-b97ddd8dc6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c76439-3c30-47b1-a13c-cee630ea057b", "tag": "354b296f-263e-4dae-87aa-7cee7e4a17bd"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:26.803673 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-1d4f9faf-7340-4490-9656-d7ffe03c34a4 req-613ddf6a-29d7-45e6-ab2f-b97ddd8dc6c7 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:26.804512 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-1d4f9faf-7340-4490-9656-d7ffe03c34a4 req-613ddf6a-29d7-45e6-ab2f-b97ddd8dc6c7 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:26.805190 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-1d4f9faf-7340-4490-9656-d7ffe03c34a4 req-613ddf6a-29d7-45e6-ab2f-b97ddd8dc6c7 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:26.827432 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-1d4f9faf-7340-4490-9656-d7ffe03c34a4 req-613ddf6a-29d7-45e6-ab2f-b97ddd8dc6c7 service nova] Creating event network-changed:354b296f-263e-4dae-87aa-7cee7e4a17bd for instance b4c76439-3c30-47b1-a13c-cee630ea057b on hv-cinder-85200 Aug 08 14:31:26.835466 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-1d4f9faf-7340-4490-9656-d7ffe03c34a4 req-613ddf6a-29d7-45e6-ab2f-b97ddd8dc6c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060672 Aug 08 14:31:26.836869 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 41/78] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:26.844438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-0fdfb8e6-6ab9-44c1-9782-a582b85504e1 req-a9218431-2b7c-44b7-a82d-1202ec3ecf18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0245e7-b0d0-4fbe-a233-4b3e7768b94c", "tag": "87f964c5-59f7-49fd-885c-ebcb610ccd3e"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:26.858161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0fdfb8e6-6ab9-44c1-9782-a582b85504e1 req-a9218431-2b7c-44b7-a82d-1202ec3ecf18 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:26.859050 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0fdfb8e6-6ab9-44c1-9782-a582b85504e1 req-a9218431-2b7c-44b7-a82d-1202ec3ecf18 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:26.860017 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0fdfb8e6-6ab9-44c1-9782-a582b85504e1 req-a9218431-2b7c-44b7-a82d-1202ec3ecf18 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:26.906079 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-0fdfb8e6-6ab9-44c1-9782-a582b85504e1 req-a9218431-2b7c-44b7-a82d-1202ec3ecf18 service nova] Creating event network-changed:87f964c5-59f7-49fd-885c-ebcb610ccd3e for instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c on hv-cinder-85200 Aug 08 14:31:26.923065 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-0fdfb8e6-6ab9-44c1-9782-a582b85504e1 req-a9218431-2b7c-44b7-a82d-1202ec3ecf18 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084429 Aug 08 14:31:26.929732 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 42/79] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:27.098718 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-90ded34e-c225-4f26-ad2f-d64097470bb8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:27.100312 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-90ded34e-c225-4f26-ad2f-d64097470bb8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:27.123778 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-90ded34e-c225-4f26-ad2f-d64097470bb8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:27.125803 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-90ded34e-c225-4f26-ad2f-d64097470bb8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:27.128369 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-90ded34e-c225-4f26-ad2f-d64097470bb8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:27.134169 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-90ded34e-c225-4f26-ad2f-d64097470bb8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:27.136304 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-90ded34e-c225-4f26-ad2f-d64097470bb8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:27.139296 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-90ded34e-c225-4f26-ad2f-d64097470bb8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:27.502771 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-11d2be9b-0431-4b3f-a779-0715a1d2de6e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:27.510264 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-11d2be9b-0431-4b3f-a779-0715a1d2de6e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 1.415553 Aug 08 14:31:27.512052 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 38/80] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:26 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:27.517797 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7f05d882-f4ac-4ea7-9064-c37625f38eff tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:27.518425 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7f05d882-f4ac-4ea7-9064-c37625f38eff tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:27.518996 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-90ded34e-c225-4f26-ad2f-d64097470bb8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:27.524793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f05d882-f4ac-4ea7-9064-c37625f38eff tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:27.525434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f05d882-f4ac-4ea7-9064-c37625f38eff tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:27.525903 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f05d882-f4ac-4ea7-9064-c37625f38eff tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:27.528164 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f05d882-f4ac-4ea7-9064-c37625f38eff tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:27.528584 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f05d882-f4ac-4ea7-9064-c37625f38eff tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:27.529208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f05d882-f4ac-4ea7-9064-c37625f38eff tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:27.535859 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-90ded34e-c225-4f26-ad2f-d64097470bb8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.444550 Aug 08 14:31:27.536211 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=100 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:31:27.546595 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 43/81] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:27 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:27.693167 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7f05d882-f4ac-4ea7-9064-c37625f38eff tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:27.705918 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7f05d882-f4ac-4ea7-9064-c37625f38eff tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:27.707814 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7f05d882-f4ac-4ea7-9064-c37625f38eff tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:27.710280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7f05d882-f4ac-4ea7-9064-c37625f38eff tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.195983 Aug 08 14:31:27.711261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 39/82] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:27 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:27.794002 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1f7ea848-6757-41b4-8afa-d2688cae372c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:27.794652 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1f7ea848-6757-41b4-8afa-d2688cae372c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:27.801338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f7ea848-6757-41b4-8afa-d2688cae372c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:27.801829 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f7ea848-6757-41b4-8afa-d2688cae372c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:27.802260 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f7ea848-6757-41b4-8afa-d2688cae372c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:27.803379 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f7ea848-6757-41b4-8afa-d2688cae372c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:27.803843 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f7ea848-6757-41b4-8afa-d2688cae372c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:27.804475 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f7ea848-6757-41b4-8afa-d2688cae372c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:28.082855 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1f7ea848-6757-41b4-8afa-d2688cae372c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:28.091841 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1f7ea848-6757-41b4-8afa-d2688cae372c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.302062 Aug 08 14:31:28.099380 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 44/83] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:27 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:28.541917 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c7b41dd1-ab94-4975-b218-825e0a70b64f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:28.542515 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c7b41dd1-ab94-4975-b218-825e0a70b64f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:28.549338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c7b41dd1-ab94-4975-b218-825e0a70b64f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:28.551188 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c7b41dd1-ab94-4975-b218-825e0a70b64f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:28.551671 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c7b41dd1-ab94-4975-b218-825e0a70b64f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:28.552590 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c7b41dd1-ab94-4975-b218-825e0a70b64f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:28.553545 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c7b41dd1-ab94-4975-b218-825e0a70b64f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:28.554175 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c7b41dd1-ab94-4975-b218-825e0a70b64f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:28.564213 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0b16f586-e21c-4f2e-9136-eb10b59d264f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:28.564822 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0b16f586-e21c-4f2e-9136-eb10b59d264f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:28.572942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0b16f586-e21c-4f2e-9136-eb10b59d264f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:28.576011 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0b16f586-e21c-4f2e-9136-eb10b59d264f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:28.576654 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0b16f586-e21c-4f2e-9136-eb10b59d264f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:28.577261 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0b16f586-e21c-4f2e-9136-eb10b59d264f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:28.581117 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0b16f586-e21c-4f2e-9136-eb10b59d264f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:28.581567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0b16f586-e21c-4f2e-9136-eb10b59d264f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:28.763965 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c7b41dd1-ab94-4975-b218-825e0a70b64f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:28.773127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c7b41dd1-ab94-4975-b218-825e0a70b64f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.235933 Aug 08 14:31:28.774007 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 40/84] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:28 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:28.779260 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-53e30743-1115-428a-a228-77cd47523aed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:28.780220 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-53e30743-1115-428a-a228-77cd47523aed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:28.790546 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-53e30743-1115-428a-a228-77cd47523aed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:28.791236 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-53e30743-1115-428a-a228-77cd47523aed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:28.792401 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-53e30743-1115-428a-a228-77cd47523aed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:28.792872 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0b16f586-e21c-4f2e-9136-eb10b59d264f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:28.794203 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-53e30743-1115-428a-a228-77cd47523aed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:28.795168 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-53e30743-1115-428a-a228-77cd47523aed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:28.796513 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-53e30743-1115-428a-a228-77cd47523aed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:28.806881 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0b16f586-e21c-4f2e-9136-eb10b59d264f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.246308 Aug 08 14:31:28.807602 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 45/85] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:28 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:28.951291 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-53e30743-1115-428a-a228-77cd47523aed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:28.961217 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-53e30743-1115-428a-a228-77cd47523aed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:28.962860 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-53e30743-1115-428a-a228-77cd47523aed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:28.965741 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-53e30743-1115-428a-a228-77cd47523aed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.190592 Aug 08 14:31:28.975673 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 41/86] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:28 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:29.113696 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2c0108f4-7228-4b99-b6f7-aa3f6917d82c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:29.114685 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2c0108f4-7228-4b99-b6f7-aa3f6917d82c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:29.121599 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2c0108f4-7228-4b99-b6f7-aa3f6917d82c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:29.124168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2c0108f4-7228-4b99-b6f7-aa3f6917d82c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:29.124168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2c0108f4-7228-4b99-b6f7-aa3f6917d82c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:29.124168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2c0108f4-7228-4b99-b6f7-aa3f6917d82c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:29.124168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2c0108f4-7228-4b99-b6f7-aa3f6917d82c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:29.124788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2c0108f4-7228-4b99-b6f7-aa3f6917d82c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:29.292313 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2c0108f4-7228-4b99-b6f7-aa3f6917d82c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:29.302070 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2c0108f4-7228-4b99-b6f7-aa3f6917d82c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.192997 Aug 08 14:31:29.302950 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 46/87] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:29 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:29.798214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-96e98994-cd5f-46f8-9225-671c0fbcb524 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:29.800718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-96e98994-cd5f-46f8-9225-671c0fbcb524 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:29.808582 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-96e98994-cd5f-46f8-9225-671c0fbcb524 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:29.809369 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-96e98994-cd5f-46f8-9225-671c0fbcb524 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:29.809814 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-96e98994-cd5f-46f8-9225-671c0fbcb524 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:29.810686 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-96e98994-cd5f-46f8-9225-671c0fbcb524 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:29.811202 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-96e98994-cd5f-46f8-9225-671c0fbcb524 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:29.812162 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-96e98994-cd5f-46f8-9225-671c0fbcb524 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:29.830717 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-18fef5df-d4d7-4917-81b4-69375d173662 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:29.832449 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-18fef5df-d4d7-4917-81b4-69375d173662 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:29.840867 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18fef5df-d4d7-4917-81b4-69375d173662 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:29.841782 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18fef5df-d4d7-4917-81b4-69375d173662 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:29.843139 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18fef5df-d4d7-4917-81b4-69375d173662 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:29.845278 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18fef5df-d4d7-4917-81b4-69375d173662 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:29.845981 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18fef5df-d4d7-4917-81b4-69375d173662 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:29.846692 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18fef5df-d4d7-4917-81b4-69375d173662 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:29.872454 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=100 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:31:30.074736 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-96e98994-cd5f-46f8-9225-671c0fbcb524 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:30.078483 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-18fef5df-d4d7-4917-81b4-69375d173662 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:30.082910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-96e98994-cd5f-46f8-9225-671c0fbcb524 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.290586 Aug 08 14:31:30.083596 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 42/88] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:29 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:30.087316 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-18fef5df-d4d7-4917-81b4-69375d173662 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.260757 Aug 08 14:31:30.087889 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 47/89] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:29 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:31:30.089816 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bd3b5d51-810e-4636-a136-9014189ed856 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:30.090518 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bd3b5d51-810e-4636-a136-9014189ed856 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:30.097600 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bd3b5d51-810e-4636-a136-9014189ed856 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:30.098190 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bd3b5d51-810e-4636-a136-9014189ed856 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:30.098696 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bd3b5d51-810e-4636-a136-9014189ed856 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:30.099585 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bd3b5d51-810e-4636-a136-9014189ed856 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:30.100292 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bd3b5d51-810e-4636-a136-9014189ed856 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:30.100847 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bd3b5d51-810e-4636-a136-9014189ed856 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:30.333648 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b593b3aa-effa-495a-b2f3-ccf4cd6f2301 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:30.335019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b593b3aa-effa-495a-b2f3-ccf4cd6f2301 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:30.341108 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b593b3aa-effa-495a-b2f3-ccf4cd6f2301 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:30.341863 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b593b3aa-effa-495a-b2f3-ccf4cd6f2301 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:30.342498 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b593b3aa-effa-495a-b2f3-ccf4cd6f2301 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:30.343446 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b593b3aa-effa-495a-b2f3-ccf4cd6f2301 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:30.344117 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b593b3aa-effa-495a-b2f3-ccf4cd6f2301 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:30.344738 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b593b3aa-effa-495a-b2f3-ccf4cd6f2301 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:30.355589 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bd3b5d51-810e-4636-a136-9014189ed856 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:30.366511 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bd3b5d51-810e-4636-a136-9014189ed856 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:30.368829 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bd3b5d51-810e-4636-a136-9014189ed856 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:30.370145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bd3b5d51-810e-4636-a136-9014189ed856 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.284995 Aug 08 14:31:30.371302 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 43/90] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:30 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:30.484284 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b593b3aa-effa-495a-b2f3-ccf4cd6f2301 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:30.492711 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b593b3aa-effa-495a-b2f3-ccf4cd6f2301 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.162789 Aug 08 14:31:30.493341 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 48/91] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:30 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:31:31.113967 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6873d401-743d-420f-83ac-640a39bb309b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:31.114553 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3ba0ef22-6811-476a-9661-fed490830df5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:31.116056 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3ba0ef22-6811-476a-9661-fed490830df5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:31.116855 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6873d401-743d-420f-83ac-640a39bb309b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:31.134334 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3ba0ef22-6811-476a-9661-fed490830df5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:31.140040 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3ba0ef22-6811-476a-9661-fed490830df5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:31.140565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3ba0ef22-6811-476a-9661-fed490830df5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:31.141987 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6873d401-743d-420f-83ac-640a39bb309b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:31.143718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6873d401-743d-420f-83ac-640a39bb309b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:31.146125 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6873d401-743d-420f-83ac-640a39bb309b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:31.147374 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3ba0ef22-6811-476a-9661-fed490830df5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:31.148089 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6873d401-743d-420f-83ac-640a39bb309b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:31.149201 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6873d401-743d-420f-83ac-640a39bb309b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:31.149404 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3ba0ef22-6811-476a-9661-fed490830df5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:31.150912 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3ba0ef22-6811-476a-9661-fed490830df5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:31.151292 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6873d401-743d-420f-83ac-640a39bb309b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:31.595440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6873d401-743d-420f-83ac-640a39bb309b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:31.603402 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3ba0ef22-6811-476a-9661-fed490830df5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:31.611538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6873d401-743d-420f-83ac-640a39bb309b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.509874 Aug 08 14:31:31.614020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3ba0ef22-6811-476a-9661-fed490830df5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.504949 Aug 08 14:31:31.614911 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 49/92] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:31 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:31.615256 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 44/93] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:31 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:31.621532 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-946eef5a-3123-48bb-803a-c50998a20e79 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:31.622279 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-633fd5cf-c17f-4f5b-a190-0224703d8874 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:31.622924 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-946eef5a-3123-48bb-803a-c50998a20e79 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:31.628909 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-633fd5cf-c17f-4f5b-a190-0224703d8874 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:31.631728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-946eef5a-3123-48bb-803a-c50998a20e79 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:31.632859 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-946eef5a-3123-48bb-803a-c50998a20e79 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:31.633661 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-946eef5a-3123-48bb-803a-c50998a20e79 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:31.635232 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-946eef5a-3123-48bb-803a-c50998a20e79 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:31.636678 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-946eef5a-3123-48bb-803a-c50998a20e79 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:31.637504 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-946eef5a-3123-48bb-803a-c50998a20e79 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:31.651015 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-633fd5cf-c17f-4f5b-a190-0224703d8874 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:31.653880 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-633fd5cf-c17f-4f5b-a190-0224703d8874 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:31.654481 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-633fd5cf-c17f-4f5b-a190-0224703d8874 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:31.656149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-633fd5cf-c17f-4f5b-a190-0224703d8874 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:31.657334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-633fd5cf-c17f-4f5b-a190-0224703d8874 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:31.659213 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-633fd5cf-c17f-4f5b-a190-0224703d8874 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:31.951203 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-633fd5cf-c17f-4f5b-a190-0224703d8874 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:31.961050 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-633fd5cf-c17f-4f5b-a190-0224703d8874 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:31.966772 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-633fd5cf-c17f-4f5b-a190-0224703d8874 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:31.970271 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-633fd5cf-c17f-4f5b-a190-0224703d8874 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.353534 Aug 08 14:31:31.970843 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 45/94] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:31 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:31.975991 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-946eef5a-3123-48bb-803a-c50998a20e79 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:31.986619 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-946eef5a-3123-48bb-803a-c50998a20e79 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.369763 Aug 08 14:31:31.989814 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 50/95] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:31 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:32.643390 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-87f51bf6-8b2e-4295-b9d2-7e656580f25a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:32.645014 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-87f51bf6-8b2e-4295-b9d2-7e656580f25a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:32.654388 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c2095662-c924-4b30-84f3-8d17c55c9d5d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:32.655759 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c2095662-c924-4b30-84f3-8d17c55c9d5d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:32.676888 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c2095662-c924-4b30-84f3-8d17c55c9d5d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:32.679955 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c2095662-c924-4b30-84f3-8d17c55c9d5d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:32.680626 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-87f51bf6-8b2e-4295-b9d2-7e656580f25a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:32.681298 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-87f51bf6-8b2e-4295-b9d2-7e656580f25a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:32.681694 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c2095662-c924-4b30-84f3-8d17c55c9d5d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:32.682662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c2095662-c924-4b30-84f3-8d17c55c9d5d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:32.683520 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-87f51bf6-8b2e-4295-b9d2-7e656580f25a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:32.687572 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c2095662-c924-4b30-84f3-8d17c55c9d5d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:32.688499 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-87f51bf6-8b2e-4295-b9d2-7e656580f25a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:32.688999 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c2095662-c924-4b30-84f3-8d17c55c9d5d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:32.689796 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-87f51bf6-8b2e-4295-b9d2-7e656580f25a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:32.691415 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-87f51bf6-8b2e-4295-b9d2-7e656580f25a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:33.209496 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-87f51bf6-8b2e-4295-b9d2-7e656580f25a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:33.233796 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c2095662-c924-4b30-84f3-8d17c55c9d5d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:33.250000 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-87f51bf6-8b2e-4295-b9d2-7e656580f25a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.618843 Aug 08 14:31:33.250780 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 46/96] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:32 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:33.252914 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c2095662-c924-4b30-84f3-8d17c55c9d5d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.599023 Aug 08 14:31:33.253677 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 51/97] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:32 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:31:33.273527 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-557cbdbc-e2ae-4048-a309-d951e119a5b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:33.275888 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-557cbdbc-e2ae-4048-a309-d951e119a5b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:33.279798 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-be519d32-cd06-4892-843f-e0a5d4a5d767 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:33.280468 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-be519d32-cd06-4892-843f-e0a5d4a5d767 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:33.296351 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-557cbdbc-e2ae-4048-a309-d951e119a5b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:33.301712 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-557cbdbc-e2ae-4048-a309-d951e119a5b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:33.302182 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-557cbdbc-e2ae-4048-a309-d951e119a5b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:33.304390 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-557cbdbc-e2ae-4048-a309-d951e119a5b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:33.304893 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-557cbdbc-e2ae-4048-a309-d951e119a5b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:33.305337 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-557cbdbc-e2ae-4048-a309-d951e119a5b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:33.311675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be519d32-cd06-4892-843f-e0a5d4a5d767 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:33.313380 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be519d32-cd06-4892-843f-e0a5d4a5d767 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:33.313831 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be519d32-cd06-4892-843f-e0a5d4a5d767 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:33.315869 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be519d32-cd06-4892-843f-e0a5d4a5d767 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:33.316342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be519d32-cd06-4892-843f-e0a5d4a5d767 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:33.316865 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be519d32-cd06-4892-843f-e0a5d4a5d767 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:33.448038 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:31:33.516112 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-557cbdbc-e2ae-4048-a309-d951e119a5b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:33.533484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-557cbdbc-e2ae-4048-a309-d951e119a5b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:33.535482 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-557cbdbc-e2ae-4048-a309-d951e119a5b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:33.537440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-557cbdbc-e2ae-4048-a309-d951e119a5b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.284199 Aug 08 14:31:33.537905 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 47/98] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:33 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:33.574803 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-be519d32-cd06-4892-843f-e0a5d4a5d767 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:33.586568 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-be519d32-cd06-4892-843f-e0a5d4a5d767 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.331168 Aug 08 14:31:33.587171 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 52/99] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:33 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:34.277080 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0042a98c-90fe-4b1e-a6be-459ad456a13d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:34.279020 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bc72c8fb-cc4d-498c-9484-ba85894f5d01 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:34.280221 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0042a98c-90fe-4b1e-a6be-459ad456a13d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:34.281021 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bc72c8fb-cc4d-498c-9484-ba85894f5d01 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:34.288434 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:31:34.302491 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0042a98c-90fe-4b1e-a6be-459ad456a13d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:34.304995 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bc72c8fb-cc4d-498c-9484-ba85894f5d01 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:34.308148 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bc72c8fb-cc4d-498c-9484-ba85894f5d01 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:34.309234 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bc72c8fb-cc4d-498c-9484-ba85894f5d01 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:34.310173 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0042a98c-90fe-4b1e-a6be-459ad456a13d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:34.311319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bc72c8fb-cc4d-498c-9484-ba85894f5d01 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:34.311961 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0042a98c-90fe-4b1e-a6be-459ad456a13d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:34.313034 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0042a98c-90fe-4b1e-a6be-459ad456a13d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:34.314247 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bc72c8fb-cc4d-498c-9484-ba85894f5d01 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:34.319751 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0042a98c-90fe-4b1e-a6be-459ad456a13d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:34.320439 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bc72c8fb-cc4d-498c-9484-ba85894f5d01 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:34.322850 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0042a98c-90fe-4b1e-a6be-459ad456a13d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:34.818598 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bc72c8fb-cc4d-498c-9484-ba85894f5d01 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:34.830306 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bc72c8fb-cc4d-498c-9484-ba85894f5d01 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.561613 Aug 08 14:31:34.830999 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 48/100] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:34 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:34.840153 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4105f3cc-89db-4ead-adc8-8706e357a07f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:34.841345 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-4105f3cc-89db-4ead-adc8-8706e357a07f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:34.848009 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4105f3cc-89db-4ead-adc8-8706e357a07f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:34.848719 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4105f3cc-89db-4ead-adc8-8706e357a07f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:34.849870 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4105f3cc-89db-4ead-adc8-8706e357a07f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:34.850778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4105f3cc-89db-4ead-adc8-8706e357a07f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:34.851467 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4105f3cc-89db-4ead-adc8-8706e357a07f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:34.851994 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4105f3cc-89db-4ead-adc8-8706e357a07f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:34.916975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0042a98c-90fe-4b1e-a6be-459ad456a13d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:34.924988 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0042a98c-90fe-4b1e-a6be-459ad456a13d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.651658 Aug 08 14:31:34.925850 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 53/101] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:34 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:34.931791 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6031f703-15a0-4319-aa6b-a53ab177e4fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:34.932792 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6031f703-15a0-4319-aa6b-a53ab177e4fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:34.939848 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6031f703-15a0-4319-aa6b-a53ab177e4fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:34.940543 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6031f703-15a0-4319-aa6b-a53ab177e4fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:34.941511 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6031f703-15a0-4319-aa6b-a53ab177e4fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:34.942377 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6031f703-15a0-4319-aa6b-a53ab177e4fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:34.943006 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6031f703-15a0-4319-aa6b-a53ab177e4fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:34.943617 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6031f703-15a0-4319-aa6b-a53ab177e4fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:35.089647 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4105f3cc-89db-4ead-adc8-8706e357a07f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:35.098722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4105f3cc-89db-4ead-adc8-8706e357a07f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:35.100856 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4105f3cc-89db-4ead-adc8-8706e357a07f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:35.101983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-4105f3cc-89db-4ead-adc8-8706e357a07f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.269814 Aug 08 14:31:35.104453 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 49/102] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:34 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:35.153856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6031f703-15a0-4319-aa6b-a53ab177e4fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:35.163341 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6031f703-15a0-4319-aa6b-a53ab177e4fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.236199 Aug 08 14:31:35.163920 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 54/103] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:34 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:35.857587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-89ebaee9-4603-40d7-a1fe-c22f2054e085 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:35.858407 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-89ebaee9-4603-40d7-a1fe-c22f2054e085 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:35.868428 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-89ebaee9-4603-40d7-a1fe-c22f2054e085 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:35.869295 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-89ebaee9-4603-40d7-a1fe-c22f2054e085 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:35.870037 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-89ebaee9-4603-40d7-a1fe-c22f2054e085 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:35.870953 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-89ebaee9-4603-40d7-a1fe-c22f2054e085 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:35.872680 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-89ebaee9-4603-40d7-a1fe-c22f2054e085 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:35.873332 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-89ebaee9-4603-40d7-a1fe-c22f2054e085 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:35.949074 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-89ffe673-baa2-4e5d-8b4a-0afb4f877836 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:35.950242 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-89ffe673-baa2-4e5d-8b4a-0afb4f877836 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:35.958854 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-89ffe673-baa2-4e5d-8b4a-0afb4f877836 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:35.960677 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-89ffe673-baa2-4e5d-8b4a-0afb4f877836 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:35.961112 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-89ffe673-baa2-4e5d-8b4a-0afb4f877836 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:35.962423 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-89ffe673-baa2-4e5d-8b4a-0afb4f877836 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:35.962962 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-89ffe673-baa2-4e5d-8b4a-0afb4f877836 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:35.963957 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-89ffe673-baa2-4e5d-8b4a-0afb4f877836 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:36.078247 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-89ebaee9-4603-40d7-a1fe-c22f2054e085 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:36.088578 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-89ebaee9-4603-40d7-a1fe-c22f2054e085 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.236979 Aug 08 14:31:36.089532 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 50/104] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:35 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:36.128928 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ad60327f-9eab-4e96-8055-f1aee4206e8d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:36.129828 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ad60327f-9eab-4e96-8055-f1aee4206e8d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:36.136923 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ad60327f-9eab-4e96-8055-f1aee4206e8d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:36.137669 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ad60327f-9eab-4e96-8055-f1aee4206e8d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:36.138331 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ad60327f-9eab-4e96-8055-f1aee4206e8d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:36.139484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ad60327f-9eab-4e96-8055-f1aee4206e8d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:36.140098 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ad60327f-9eab-4e96-8055-f1aee4206e8d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:36.140713 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ad60327f-9eab-4e96-8055-f1aee4206e8d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:36.232492 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-89ffe673-baa2-4e5d-8b4a-0afb4f877836 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:36.241606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-89ffe673-baa2-4e5d-8b4a-0afb4f877836 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.296550 Aug 08 14:31:36.242504 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 55/105] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:35 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:36.251727 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c63d0be3-2e0d-4ffd-b3ad-6dff2f897eba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:36.252835 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c63d0be3-2e0d-4ffd-b3ad-6dff2f897eba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:36.262247 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c63d0be3-2e0d-4ffd-b3ad-6dff2f897eba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:36.262960 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c63d0be3-2e0d-4ffd-b3ad-6dff2f897eba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:36.263482 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c63d0be3-2e0d-4ffd-b3ad-6dff2f897eba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:36.264240 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c63d0be3-2e0d-4ffd-b3ad-6dff2f897eba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:36.264876 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c63d0be3-2e0d-4ffd-b3ad-6dff2f897eba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:36.265825 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c63d0be3-2e0d-4ffd-b3ad-6dff2f897eba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:36.392303 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ad60327f-9eab-4e96-8055-f1aee4206e8d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:36.403512 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ad60327f-9eab-4e96-8055-f1aee4206e8d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:36.411269 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ad60327f-9eab-4e96-8055-f1aee4206e8d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:36.413173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ad60327f-9eab-4e96-8055-f1aee4206e8d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.290887 Aug 08 14:31:36.417318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 51/106] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:36 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:31:36.467628 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c63d0be3-2e0d-4ffd-b3ad-6dff2f897eba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:36.479989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c63d0be3-2e0d-4ffd-b3ad-6dff2f897eba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.235964 Aug 08 14:31:36.480572 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 56/107] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:36 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:37.110238 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2e0eebcf-8a41-4f38-b279-b6f3050a0011 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:37.111946 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2e0eebcf-8a41-4f38-b279-b6f3050a0011 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:37.124215 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e0eebcf-8a41-4f38-b279-b6f3050a0011 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:37.125101 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e0eebcf-8a41-4f38-b279-b6f3050a0011 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:37.126772 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e0eebcf-8a41-4f38-b279-b6f3050a0011 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:37.129022 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e0eebcf-8a41-4f38-b279-b6f3050a0011 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:37.131244 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e0eebcf-8a41-4f38-b279-b6f3050a0011 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:37.132203 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e0eebcf-8a41-4f38-b279-b6f3050a0011 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:37.281992 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-5cf6d4f3-d86a-4277-b23d-5604906aa8bd req-5d8b2546-8db2-4910-9aa1-3e8703937f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70", "name": "network-vif-plugged", "status": "completed", "tag": "18cae069-68b0-4e95-807f-a1cd956485f8"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:37.304548 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-5cf6d4f3-d86a-4277-b23d-5604906aa8bd req-5d8b2546-8db2-4910-9aa1-3e8703937f7d service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:37.312114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-5cf6d4f3-d86a-4277-b23d-5604906aa8bd req-5d8b2546-8db2-4910-9aa1-3e8703937f7d service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:37.312715 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-5cf6d4f3-d86a-4277-b23d-5604906aa8bd req-5d8b2546-8db2-4910-9aa1-3e8703937f7d service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:37.333212 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-5cf6d4f3-d86a-4277-b23d-5604906aa8bd req-5d8b2546-8db2-4910-9aa1-3e8703937f7d service nova] Creating event network-vif-plugged:18cae069-68b0-4e95-807f-a1cd956485f8 for instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 on hv-cinder-85200 Aug 08 14:31:37.347453 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-5cf6d4f3-d86a-4277-b23d-5604906aa8bd req-5d8b2546-8db2-4910-9aa1-3e8703937f7d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.300016 Aug 08 14:31:37.352446 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 52/108] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:37.370466 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c44a4af1-b430-4850-b79f-46417223b59d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:37.377374 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c44a4af1-b430-4850-b79f-46417223b59d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:37.390654 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c44a4af1-b430-4850-b79f-46417223b59d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:37.392040 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c44a4af1-b430-4850-b79f-46417223b59d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:37.392439 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2e0eebcf-8a41-4f38-b279-b6f3050a0011 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:37.393072 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c44a4af1-b430-4850-b79f-46417223b59d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:37.395322 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c44a4af1-b430-4850-b79f-46417223b59d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:37.395909 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c44a4af1-b430-4850-b79f-46417223b59d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:37.396485 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c44a4af1-b430-4850-b79f-46417223b59d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:37.401663 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2e0eebcf-8a41-4f38-b279-b6f3050a0011 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.296151 Aug 08 14:31:37.404475 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 57/109] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:37 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:37.442379 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1ad4b29e-e305-4716-a518-a0c4e84139b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:37.443879 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1ad4b29e-e305-4716-a518-a0c4e84139b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:37.462339 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ad4b29e-e305-4716-a518-a0c4e84139b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:37.462873 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ad4b29e-e305-4716-a518-a0c4e84139b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:37.463361 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ad4b29e-e305-4716-a518-a0c4e84139b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:37.470212 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ad4b29e-e305-4716-a518-a0c4e84139b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:37.470775 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ad4b29e-e305-4716-a518-a0c4e84139b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:37.475478 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ad4b29e-e305-4716-a518-a0c4e84139b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:37.826881 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c44a4af1-b430-4850-b79f-46417223b59d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:37.839046 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c44a4af1-b430-4850-b79f-46417223b59d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.484112 Aug 08 14:31:37.842550 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 53/110] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:37 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:37.850928 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-61d5ff8c-559a-4110-86d4-6f82925c3853 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:37.851748 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-61d5ff8c-559a-4110-86d4-6f82925c3853 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:37.859577 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-61d5ff8c-559a-4110-86d4-6f82925c3853 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:37.860280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-61d5ff8c-559a-4110-86d4-6f82925c3853 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:37.864069 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-61d5ff8c-559a-4110-86d4-6f82925c3853 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:37.870490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-61d5ff8c-559a-4110-86d4-6f82925c3853 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:37.870985 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-61d5ff8c-559a-4110-86d4-6f82925c3853 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:37.871458 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-61d5ff8c-559a-4110-86d4-6f82925c3853 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:37.903058 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1ad4b29e-e305-4716-a518-a0c4e84139b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:37.916061 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1ad4b29e-e305-4716-a518-a0c4e84139b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:37.922780 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1ad4b29e-e305-4716-a518-a0c4e84139b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:37.927167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1ad4b29e-e305-4716-a518-a0c4e84139b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.487767 Aug 08 14:31:37.929173 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 58/111] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:37 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:31:38.127271 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-61d5ff8c-559a-4110-86d4-6f82925c3853 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:38.137782 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-61d5ff8c-559a-4110-86d4-6f82925c3853 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.292072 Aug 08 14:31:38.144742 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 54/112] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:37 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:38.436059 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a62e142a-5f9a-4212-8005-1f30eee31796 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:38.436729 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a62e142a-5f9a-4212-8005-1f30eee31796 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:38.449339 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a62e142a-5f9a-4212-8005-1f30eee31796 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:38.449850 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a62e142a-5f9a-4212-8005-1f30eee31796 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:38.450272 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a62e142a-5f9a-4212-8005-1f30eee31796 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:38.450980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a62e142a-5f9a-4212-8005-1f30eee31796 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:38.451461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a62e142a-5f9a-4212-8005-1f30eee31796 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:38.451879 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a62e142a-5f9a-4212-8005-1f30eee31796 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:38.626195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a62e142a-5f9a-4212-8005-1f30eee31796 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:38.642109 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a62e142a-5f9a-4212-8005-1f30eee31796 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.219378 Aug 08 14:31:38.643187 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 59/113] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:38 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:38.868961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e79a4366-9e1b-4f8c-8841-d075a0418a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:38.869684 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e79a4366-9e1b-4f8c-8841-d075a0418a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:38.876998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e79a4366-9e1b-4f8c-8841-d075a0418a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:38.877494 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e79a4366-9e1b-4f8c-8841-d075a0418a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:38.878107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e79a4366-9e1b-4f8c-8841-d075a0418a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:38.879433 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e79a4366-9e1b-4f8c-8841-d075a0418a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:38.880065 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e79a4366-9e1b-4f8c-8841-d075a0418a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:38.880973 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e79a4366-9e1b-4f8c-8841-d075a0418a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:38.954352 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-67f11208-e9db-402d-92c5-c73eb897530b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:38.955516 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-67f11208-e9db-402d-92c5-c73eb897530b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:38.969906 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-67f11208-e9db-402d-92c5-c73eb897530b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:38.970750 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-67f11208-e9db-402d-92c5-c73eb897530b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:38.972492 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-67f11208-e9db-402d-92c5-c73eb897530b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:38.982677 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-67f11208-e9db-402d-92c5-c73eb897530b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:38.983492 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-67f11208-e9db-402d-92c5-c73eb897530b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:38.983943 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-67f11208-e9db-402d-92c5-c73eb897530b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:39.176806 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e79a4366-9e1b-4f8c-8841-d075a0418a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:39.184808 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e79a4366-9e1b-4f8c-8841-d075a0418a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.319912 Aug 08 14:31:39.185396 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 55/114] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:38 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:39.191216 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e2828366-1793-47ab-b3b9-6499a84783ac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:39.192435 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e2828366-1793-47ab-b3b9-6499a84783ac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:39.203727 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e2828366-1793-47ab-b3b9-6499a84783ac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:39.204220 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e2828366-1793-47ab-b3b9-6499a84783ac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:39.204663 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e2828366-1793-47ab-b3b9-6499a84783ac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:39.205374 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e2828366-1793-47ab-b3b9-6499a84783ac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:39.205833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e2828366-1793-47ab-b3b9-6499a84783ac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:39.206262 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e2828366-1793-47ab-b3b9-6499a84783ac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:39.207532 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-67f11208-e9db-402d-92c5-c73eb897530b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:39.216519 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-67f11208-e9db-402d-92c5-c73eb897530b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:39.218464 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-67f11208-e9db-402d-92c5-c73eb897530b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:39.219617 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-67f11208-e9db-402d-92c5-c73eb897530b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.271194 Aug 08 14:31:39.220375 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 60/115] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:38 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:39.225988 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=100 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:31:39.351332 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e2828366-1793-47ab-b3b9-6499a84783ac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:39.363137 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e2828366-1793-47ab-b3b9-6499a84783ac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.176240 Aug 08 14:31:39.364094 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 56/116] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:39 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:39.456655 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-5c6afa1d-0d50-4a6b-a2a6-13acdee695d6 req-ec31ecb3-5531-4276-8a1a-9a5cc986c191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c76439-3c30-47b1-a13c-cee630ea057b", "name": "network-vif-plugged", "status": "completed", "tag": "354b296f-263e-4dae-87aa-7cee7e4a17bd"}, {"server_uuid": "fd0245e7-b0d0-4fbe-a233-4b3e7768b94c", "name": "network-vif-plugged", "status": "completed", "tag": "87f964c5-59f7-49fd-885c-ebcb610ccd3e"}, {"server_uuid": "fdd0ce81-8365-4812-b309-d3d873311c3a", "name": "network-vif-plugged", "status": "completed", "tag": "496b1c03-1e52-4f57-bbae-16f42a9a9f5c"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:39.468376 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-5c6afa1d-0d50-4a6b-a2a6-13acdee695d6 req-ec31ecb3-5531-4276-8a1a-9a5cc986c191 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:39.469025 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-5c6afa1d-0d50-4a6b-a2a6-13acdee695d6 req-ec31ecb3-5531-4276-8a1a-9a5cc986c191 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:39.469447 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-5c6afa1d-0d50-4a6b-a2a6-13acdee695d6 req-ec31ecb3-5531-4276-8a1a-9a5cc986c191 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:39.484114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-5c6afa1d-0d50-4a6b-a2a6-13acdee695d6 req-ec31ecb3-5531-4276-8a1a-9a5cc986c191 service nova] Creating event network-vif-plugged:354b296f-263e-4dae-87aa-7cee7e4a17bd for instance b4c76439-3c30-47b1-a13c-cee630ea057b on hv-cinder-85200 Aug 08 14:31:39.484618 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-5c6afa1d-0d50-4a6b-a2a6-13acdee695d6 req-ec31ecb3-5531-4276-8a1a-9a5cc986c191 service nova] Creating event network-vif-plugged:87f964c5-59f7-49fd-885c-ebcb610ccd3e for instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c on hv-cinder-85200 Aug 08 14:31:39.485112 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-5c6afa1d-0d50-4a6b-a2a6-13acdee695d6 req-ec31ecb3-5531-4276-8a1a-9a5cc986c191 service nova] Creating event network-vif-plugged:496b1c03-1e52-4f57-bbae-16f42a9a9f5c for instance fdd0ce81-8365-4812-b309-d3d873311c3a on hv-cinder-85200 Aug 08 14:31:39.495882 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-5c6afa1d-0d50-4a6b-a2a6-13acdee695d6 req-ec31ecb3-5531-4276-8a1a-9a5cc986c191 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.043369 Aug 08 14:31:39.496469 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 61/117] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:39.662542 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a6e15abb-de6a-4d12-95e5-32ab82be028a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:39.663166 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-a6e15abb-de6a-4d12-95e5-32ab82be028a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:39.669122 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a6e15abb-de6a-4d12-95e5-32ab82be028a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:39.669792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a6e15abb-de6a-4d12-95e5-32ab82be028a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:39.670226 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a6e15abb-de6a-4d12-95e5-32ab82be028a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:39.670909 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a6e15abb-de6a-4d12-95e5-32ab82be028a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:39.671382 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a6e15abb-de6a-4d12-95e5-32ab82be028a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:39.671822 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a6e15abb-de6a-4d12-95e5-32ab82be028a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:39.806345 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-a6e15abb-de6a-4d12-95e5-32ab82be028a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:39.814873 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-a6e15abb-de6a-4d12-95e5-32ab82be028a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.156121 Aug 08 14:31:39.815575 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 57/118] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:39 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:40.206488 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-62b4953a-8cc9-4c84-bf90-be8757a5995f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:40.207333 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-62b4953a-8cc9-4c84-bf90-be8757a5995f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:40.213773 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62b4953a-8cc9-4c84-bf90-be8757a5995f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:40.214264 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62b4953a-8cc9-4c84-bf90-be8757a5995f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:40.214704 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62b4953a-8cc9-4c84-bf90-be8757a5995f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:40.215431 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62b4953a-8cc9-4c84-bf90-be8757a5995f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:40.215890 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62b4953a-8cc9-4c84-bf90-be8757a5995f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:40.216317 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62b4953a-8cc9-4c84-bf90-be8757a5995f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:40.244823 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-deb3d389-847d-48dd-a90d-74311eb2f0d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:40.245925 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-deb3d389-847d-48dd-a90d-74311eb2f0d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:40.253539 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-deb3d389-847d-48dd-a90d-74311eb2f0d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:40.254027 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-deb3d389-847d-48dd-a90d-74311eb2f0d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:40.254454 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-deb3d389-847d-48dd-a90d-74311eb2f0d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:40.255858 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-deb3d389-847d-48dd-a90d-74311eb2f0d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:40.256463 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-deb3d389-847d-48dd-a90d-74311eb2f0d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:40.256884 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-deb3d389-847d-48dd-a90d-74311eb2f0d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:40.409612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-62b4953a-8cc9-4c84-bf90-be8757a5995f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:40.417275 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-62b4953a-8cc9-4c84-bf90-be8757a5995f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.215263 Aug 08 14:31:40.418175 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 62/119] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:40 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:40.427683 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1844931a-4922-4d52-9030-12923378df8c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:40.428512 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1844931a-4922-4d52-9030-12923378df8c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:40.435108 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1844931a-4922-4d52-9030-12923378df8c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:40.435616 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1844931a-4922-4d52-9030-12923378df8c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:40.436052 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1844931a-4922-4d52-9030-12923378df8c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:40.436759 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1844931a-4922-4d52-9030-12923378df8c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:40.437215 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-deb3d389-847d-48dd-a90d-74311eb2f0d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:40.437346 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1844931a-4922-4d52-9030-12923378df8c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:40.437644 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1844931a-4922-4d52-9030-12923378df8c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:40.446161 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-deb3d389-847d-48dd-a90d-74311eb2f0d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:40.447725 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-deb3d389-847d-48dd-a90d-74311eb2f0d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:40.448851 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-deb3d389-847d-48dd-a90d-74311eb2f0d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.207865 Aug 08 14:31:40.449496 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 58/120] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:40 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:40.570083 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1844931a-4922-4d52-9030-12923378df8c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:40.577515 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1844931a-4922-4d52-9030-12923378df8c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.158384 Aug 08 14:31:40.578083 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 63/121] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:40 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:40.837655 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1dc4e608-d339-4df9-929f-15f9e6bdc307 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:40.838266 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1dc4e608-d339-4df9-929f-15f9e6bdc307 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:40.844777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1dc4e608-d339-4df9-929f-15f9e6bdc307 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:40.845256 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1dc4e608-d339-4df9-929f-15f9e6bdc307 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:40.845849 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1dc4e608-d339-4df9-929f-15f9e6bdc307 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:40.846572 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1dc4e608-d339-4df9-929f-15f9e6bdc307 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:40.847033 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1dc4e608-d339-4df9-929f-15f9e6bdc307 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:40.847501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1dc4e608-d339-4df9-929f-15f9e6bdc307 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:40.984839 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-1dc4e608-d339-4df9-929f-15f9e6bdc307 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:40.992215 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1dc4e608-d339-4df9-929f-15f9e6bdc307 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.159387 Aug 08 14:31:40.992782 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 59/122] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:40 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:41.440448 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-58b1ac6f-e7f1-495b-96ba-f80dc5997924 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:41.441090 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-58b1ac6f-e7f1-495b-96ba-f80dc5997924 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:41.448055 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58b1ac6f-e7f1-495b-96ba-f80dc5997924 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:41.448670 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58b1ac6f-e7f1-495b-96ba-f80dc5997924 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:41.449162 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58b1ac6f-e7f1-495b-96ba-f80dc5997924 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:41.450160 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58b1ac6f-e7f1-495b-96ba-f80dc5997924 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:41.450675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58b1ac6f-e7f1-495b-96ba-f80dc5997924 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:41.451990 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58b1ac6f-e7f1-495b-96ba-f80dc5997924 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:41.473983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-32befd57-b292-4705-b2bf-8bf9f763e1b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:41.475578 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-32befd57-b292-4705-b2bf-8bf9f763e1b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:41.484618 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-32befd57-b292-4705-b2bf-8bf9f763e1b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:41.485511 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-32befd57-b292-4705-b2bf-8bf9f763e1b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:41.486333 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-32befd57-b292-4705-b2bf-8bf9f763e1b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:41.487439 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-32befd57-b292-4705-b2bf-8bf9f763e1b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:41.488158 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-32befd57-b292-4705-b2bf-8bf9f763e1b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:41.489056 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-32befd57-b292-4705-b2bf-8bf9f763e1b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:41.738268 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-58b1ac6f-e7f1-495b-96ba-f80dc5997924 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:41.742291 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-32befd57-b292-4705-b2bf-8bf9f763e1b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:41.742709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=100 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:31:41.747776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-58b1ac6f-e7f1-495b-96ba-f80dc5997924 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.311785 Aug 08 14:31:41.748563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 64/123] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:41 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:41.752155 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-32befd57-b292-4705-b2bf-8bf9f763e1b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:41.752439 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-32befd57-b292-4705-b2bf-8bf9f763e1b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:41.753235 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-39b75de9-e690-4d2d-86a5-9443d3f201cd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:41.753901 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-32befd57-b292-4705-b2bf-8bf9f763e1b0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.286464 Aug 08 14:31:41.754182 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-39b75de9-e690-4d2d-86a5-9443d3f201cd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:41.754456 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 60/124] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:41 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:31:41.763042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-39b75de9-e690-4d2d-86a5-9443d3f201cd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:41.763042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-39b75de9-e690-4d2d-86a5-9443d3f201cd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:41.763042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-39b75de9-e690-4d2d-86a5-9443d3f201cd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:41.763042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-39b75de9-e690-4d2d-86a5-9443d3f201cd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:41.763398 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-39b75de9-e690-4d2d-86a5-9443d3f201cd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:41.763398 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-39b75de9-e690-4d2d-86a5-9443d3f201cd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:41.902929 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-39b75de9-e690-4d2d-86a5-9443d3f201cd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:41.910564 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-39b75de9-e690-4d2d-86a5-9443d3f201cd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.161021 Aug 08 14:31:41.911153 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 65/125] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:41 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:42.012421 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-eef27392-5939-47b2-b46f-59d391175e3f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:42.013023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-eef27392-5939-47b2-b46f-59d391175e3f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:42.018920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eef27392-5939-47b2-b46f-59d391175e3f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:42.019430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eef27392-5939-47b2-b46f-59d391175e3f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:42.019860 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eef27392-5939-47b2-b46f-59d391175e3f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:42.020536 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eef27392-5939-47b2-b46f-59d391175e3f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:42.020983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eef27392-5939-47b2-b46f-59d391175e3f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:42.021401 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eef27392-5939-47b2-b46f-59d391175e3f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:42.151624 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-eef27392-5939-47b2-b46f-59d391175e3f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:42.159402 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-eef27392-5939-47b2-b46f-59d391175e3f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.150717 Aug 08 14:31:42.160009 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 61/126] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:42 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:42.768591 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0aa879eb-1764-4832-97bf-8e5e02d4d1f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:42.769195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0aa879eb-1764-4832-97bf-8e5e02d4d1f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:42.775979 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0aa879eb-1764-4832-97bf-8e5e02d4d1f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:42.776245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0aa879eb-1764-4832-97bf-8e5e02d4d1f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:42.776728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0aa879eb-1764-4832-97bf-8e5e02d4d1f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:42.777343 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d4bf092a-ab09-416a-ad78-9ad25f9ee698 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:42.777808 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0aa879eb-1764-4832-97bf-8e5e02d4d1f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:42.777905 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0aa879eb-1764-4832-97bf-8e5e02d4d1f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:42.778242 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d4bf092a-ab09-416a-ad78-9ad25f9ee698 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:42.778346 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0aa879eb-1764-4832-97bf-8e5e02d4d1f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:42.785723 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4bf092a-ab09-416a-ad78-9ad25f9ee698 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:42.786461 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4bf092a-ab09-416a-ad78-9ad25f9ee698 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:42.787132 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4bf092a-ab09-416a-ad78-9ad25f9ee698 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:42.788254 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4bf092a-ab09-416a-ad78-9ad25f9ee698 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:42.789226 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4bf092a-ab09-416a-ad78-9ad25f9ee698 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:42.789993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4bf092a-ab09-416a-ad78-9ad25f9ee698 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:43.000548 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0aa879eb-1764-4832-97bf-8e5e02d4d1f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:43.004606 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d4bf092a-ab09-416a-ad78-9ad25f9ee698 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:43.008770 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0aa879eb-1764-4832-97bf-8e5e02d4d1f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.243959 Aug 08 14:31:43.024929 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 66/127] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:42 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:43.030006 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ac1c328a-d322-427c-b258-1c35817e714a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:43.030667 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ac1c328a-d322-427c-b258-1c35817e714a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:43.035393 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d4bf092a-ab09-416a-ad78-9ad25f9ee698 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:43.037284 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d4bf092a-ab09-416a-ad78-9ad25f9ee698 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:43.038465 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d4bf092a-ab09-416a-ad78-9ad25f9ee698 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.266290 Aug 08 14:31:43.039031 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 62/128] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:42 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:31:43.049454 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ac1c328a-d322-427c-b258-1c35817e714a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:43.050276 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ac1c328a-d322-427c-b258-1c35817e714a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:43.050714 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ac1c328a-d322-427c-b258-1c35817e714a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:43.051484 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ac1c328a-d322-427c-b258-1c35817e714a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:43.052000 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ac1c328a-d322-427c-b258-1c35817e714a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:43.052619 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ac1c328a-d322-427c-b258-1c35817e714a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:43.181243 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-560f27b2-178f-4a27-8dd2-a92831617313 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:43.181849 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-560f27b2-178f-4a27-8dd2-a92831617313 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:43.182677 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ac1c328a-d322-427c-b258-1c35817e714a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:43.188077 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-560f27b2-178f-4a27-8dd2-a92831617313 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:43.188563 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-560f27b2-178f-4a27-8dd2-a92831617313 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:43.188999 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-560f27b2-178f-4a27-8dd2-a92831617313 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:43.189689 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-560f27b2-178f-4a27-8dd2-a92831617313 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:43.190140 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-560f27b2-178f-4a27-8dd2-a92831617313 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:43.190562 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-560f27b2-178f-4a27-8dd2-a92831617313 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:43.190734 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ac1c328a-d322-427c-b258-1c35817e714a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.164552 Aug 08 14:31:43.191403 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 67/129] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:43 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:43.322528 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-560f27b2-178f-4a27-8dd2-a92831617313 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:43.329892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-560f27b2-178f-4a27-8dd2-a92831617313 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.152687 Aug 08 14:31:43.330467 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 63/130] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:43 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:31:44.049330 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ba4ff2cf-f7e4-4402-90c8-5f9c1a4752ab tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:44.049940 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ba4ff2cf-f7e4-4402-90c8-5f9c1a4752ab tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:44.056438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4ff2cf-f7e4-4402-90c8-5f9c1a4752ab tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:44.057049 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4ff2cf-f7e4-4402-90c8-5f9c1a4752ab tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:44.057612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4ff2cf-f7e4-4402-90c8-5f9c1a4752ab tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:44.058313 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4ff2cf-f7e4-4402-90c8-5f9c1a4752ab tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:44.058830 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4ff2cf-f7e4-4402-90c8-5f9c1a4752ab tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:44.059211 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4ff2cf-f7e4-4402-90c8-5f9c1a4752ab tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:44.061495 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-eb3b69bb-6e66-4ee5-a2aa-7f84653bf250 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:44.062319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-eb3b69bb-6e66-4ee5-a2aa-7f84653bf250 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:44.068288 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb3b69bb-6e66-4ee5-a2aa-7f84653bf250 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:44.068690 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb3b69bb-6e66-4ee5-a2aa-7f84653bf250 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:44.069128 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb3b69bb-6e66-4ee5-a2aa-7f84653bf250 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:44.070433 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb3b69bb-6e66-4ee5-a2aa-7f84653bf250 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:44.070886 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb3b69bb-6e66-4ee5-a2aa-7f84653bf250 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:44.071340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb3b69bb-6e66-4ee5-a2aa-7f84653bf250 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:44.254649 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ba4ff2cf-f7e4-4402-90c8-5f9c1a4752ab tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:44.262172 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-eb3b69bb-6e66-4ee5-a2aa-7f84653bf250 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:44.263615 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ba4ff2cf-f7e4-4402-90c8-5f9c1a4752ab tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.218153 Aug 08 14:31:44.264194 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 68/131] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:44 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:44.270145 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d96a915e-e7d2-4b74-8017-7bb3fc60bd73 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:44.270145 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d96a915e-e7d2-4b74-8017-7bb3fc60bd73 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:44.275482 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d96a915e-e7d2-4b74-8017-7bb3fc60bd73 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:44.275968 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d96a915e-e7d2-4b74-8017-7bb3fc60bd73 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:44.276417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d96a915e-e7d2-4b74-8017-7bb3fc60bd73 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:44.277394 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d96a915e-e7d2-4b74-8017-7bb3fc60bd73 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:44.277533 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d96a915e-e7d2-4b74-8017-7bb3fc60bd73 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:44.278117 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d96a915e-e7d2-4b74-8017-7bb3fc60bd73 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:44.292432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-eb3b69bb-6e66-4ee5-a2aa-7f84653bf250 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:44.295007 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-eb3b69bb-6e66-4ee5-a2aa-7f84653bf250 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:44.296344 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-eb3b69bb-6e66-4ee5-a2aa-7f84653bf250 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.238675 Aug 08 14:31:44.297447 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 64/132] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:44 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:31:44.349687 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-86060381-b312-4e22-b015-c9dc6ebcca9f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:44.350285 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-86060381-b312-4e22-b015-c9dc6ebcca9f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:44.356414 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-86060381-b312-4e22-b015-c9dc6ebcca9f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:44.356909 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-86060381-b312-4e22-b015-c9dc6ebcca9f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:44.357353 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-86060381-b312-4e22-b015-c9dc6ebcca9f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:44.358080 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-86060381-b312-4e22-b015-c9dc6ebcca9f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:44.358533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-86060381-b312-4e22-b015-c9dc6ebcca9f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:44.358955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-86060381-b312-4e22-b015-c9dc6ebcca9f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:44.451787 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d96a915e-e7d2-4b74-8017-7bb3fc60bd73 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:44.459410 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d96a915e-e7d2-4b74-8017-7bb3fc60bd73 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.194070 Aug 08 14:31:44.459986 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 69/133] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:44 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:44.510814 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-86060381-b312-4e22-b015-c9dc6ebcca9f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:44.518576 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-86060381-b312-4e22-b015-c9dc6ebcca9f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.172678 Aug 08 14:31:44.519160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 65/134] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:44 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:31:45.288382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a23019ac-2828-4fa3-85d9-438619e65438 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:45.288915 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a23019ac-2828-4fa3-85d9-438619e65438 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:45.295048 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a23019ac-2828-4fa3-85d9-438619e65438 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:45.295551 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a23019ac-2828-4fa3-85d9-438619e65438 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:45.295983 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a23019ac-2828-4fa3-85d9-438619e65438 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:45.296663 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a23019ac-2828-4fa3-85d9-438619e65438 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:45.297107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a23019ac-2828-4fa3-85d9-438619e65438 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:45.297525 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a23019ac-2828-4fa3-85d9-438619e65438 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:45.320025 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-23d14f51-c452-4660-a309-26429b975023 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:45.320703 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-23d14f51-c452-4660-a309-26429b975023 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:45.327709 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23d14f51-c452-4660-a309-26429b975023 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:45.328631 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23d14f51-c452-4660-a309-26429b975023 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:45.328713 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23d14f51-c452-4660-a309-26429b975023 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:45.329432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23d14f51-c452-4660-a309-26429b975023 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:45.337749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23d14f51-c452-4660-a309-26429b975023 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:45.339773 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23d14f51-c452-4660-a309-26429b975023 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:45.518106 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a23019ac-2828-4fa3-85d9-438619e65438 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:45.526178 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a23019ac-2828-4fa3-85d9-438619e65438 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.241823 Aug 08 14:31:45.529134 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 70/135] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:45 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:45.541722 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e0089220-158b-46a9-ae81-4d5b1fd7816a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:45.542343 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e0089220-158b-46a9-ae81-4d5b1fd7816a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:45.545632 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-23d14f51-c452-4660-a309-26429b975023 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:45.550015 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0089220-158b-46a9-ae81-4d5b1fd7816a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:45.550590 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0089220-158b-46a9-ae81-4d5b1fd7816a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:45.551701 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0089220-158b-46a9-ae81-4d5b1fd7816a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:45.552465 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0089220-158b-46a9-ae81-4d5b1fd7816a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:45.553011 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0089220-158b-46a9-ae81-4d5b1fd7816a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:45.553501 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0089220-158b-46a9-ae81-4d5b1fd7816a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:45.554428 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-23d14f51-c452-4660-a309-26429b975023 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:45.556013 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-23d14f51-c452-4660-a309-26429b975023 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:45.557113 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-23d14f51-c452-4660-a309-26429b975023 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.241895 Aug 08 14:31:45.558026 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 66/136] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:45 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:31:45.567476 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e41c0448-3736-4c87-b163-4cffa95a8fb5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:45.568081 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e41c0448-3736-4c87-b163-4cffa95a8fb5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:45.577131 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e41c0448-3736-4c87-b163-4cffa95a8fb5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:45.577708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e41c0448-3736-4c87-b163-4cffa95a8fb5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:45.578204 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e41c0448-3736-4c87-b163-4cffa95a8fb5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:45.578993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e41c0448-3736-4c87-b163-4cffa95a8fb5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:45.579535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e41c0448-3736-4c87-b163-4cffa95a8fb5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:45.580060 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e41c0448-3736-4c87-b163-4cffa95a8fb5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:45.776623 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e0089220-158b-46a9-ae81-4d5b1fd7816a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:45.778839 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e41c0448-3736-4c87-b163-4cffa95a8fb5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:45.785249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e0089220-158b-46a9-ae81-4d5b1fd7816a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.254928 Aug 08 14:31:45.785941 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 71/137] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:45 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:45.786554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e41c0448-3736-4c87-b163-4cffa95a8fb5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.227257 Aug 08 14:31:45.787132 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 67/138] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:45 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:46.549885 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a0aed7f2-f9ed-4d69-a8bc-0265592753a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:46.550549 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a0aed7f2-f9ed-4d69-a8bc-0265592753a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:46.557108 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0aed7f2-f9ed-4d69-a8bc-0265592753a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:46.557579 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0aed7f2-f9ed-4d69-a8bc-0265592753a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:46.558010 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0aed7f2-f9ed-4d69-a8bc-0265592753a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:46.558688 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0aed7f2-f9ed-4d69-a8bc-0265592753a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:46.559154 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0aed7f2-f9ed-4d69-a8bc-0265592753a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:46.559573 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0aed7f2-f9ed-4d69-a8bc-0265592753a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:46.581082 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d58362e0-b9c2-490b-9ac2-d2f8250e6d71 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:46.581716 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d58362e0-b9c2-490b-9ac2-d2f8250e6d71 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:46.587706 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d58362e0-b9c2-490b-9ac2-d2f8250e6d71 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:46.588185 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d58362e0-b9c2-490b-9ac2-d2f8250e6d71 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:46.588631 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d58362e0-b9c2-490b-9ac2-d2f8250e6d71 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:46.589310 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d58362e0-b9c2-490b-9ac2-d2f8250e6d71 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:46.589884 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d58362e0-b9c2-490b-9ac2-d2f8250e6d71 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:46.590335 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d58362e0-b9c2-490b-9ac2-d2f8250e6d71 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:46.909430 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a0aed7f2-f9ed-4d69-a8bc-0265592753a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:46.917444 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a0aed7f2-f9ed-4d69-a8bc-0265592753a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.371267 Aug 08 14:31:46.917960 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 72/139] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:46 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:46.922756 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a62048f8-f205-45cc-947f-da56cf504904 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:46.923395 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a62048f8-f205-45cc-947f-da56cf504904 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:46.931859 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d58362e0-b9c2-490b-9ac2-d2f8250e6d71 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:46.932854 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a62048f8-f205-45cc-947f-da56cf504904 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:46.933351 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a62048f8-f205-45cc-947f-da56cf504904 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:46.933787 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a62048f8-f205-45cc-947f-da56cf504904 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:46.934485 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a62048f8-f205-45cc-947f-da56cf504904 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:46.934932 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a62048f8-f205-45cc-947f-da56cf504904 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:46.935389 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a62048f8-f205-45cc-947f-da56cf504904 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:46.940454 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d58362e0-b9c2-490b-9ac2-d2f8250e6d71 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:46.941989 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d58362e0-b9c2-490b-9ac2-d2f8250e6d71 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:46.943106 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d58362e0-b9c2-490b-9ac2-d2f8250e6d71 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.365944 Aug 08 14:31:46.943669 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 68/140] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:46 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:31:46.948253 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e54d150f-570b-4156-9e05-a2804bc19fd8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:46.948858 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e54d150f-570b-4156-9e05-a2804bc19fd8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:46.954694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e54d150f-570b-4156-9e05-a2804bc19fd8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:46.955210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e54d150f-570b-4156-9e05-a2804bc19fd8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:46.955651 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e54d150f-570b-4156-9e05-a2804bc19fd8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:46.956344 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e54d150f-570b-4156-9e05-a2804bc19fd8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:46.956805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e54d150f-570b-4156-9e05-a2804bc19fd8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:46.957230 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e54d150f-570b-4156-9e05-a2804bc19fd8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:47.134667 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a62048f8-f205-45cc-947f-da56cf504904 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:47.141615 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e54d150f-570b-4156-9e05-a2804bc19fd8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:47.143403 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a62048f8-f205-45cc-947f-da56cf504904 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.224378 Aug 08 14:31:47.144292 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 73/141] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:46 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:47.150689 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e54d150f-570b-4156-9e05-a2804bc19fd8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1368 microversion: 2.1 time: 0.205949 Aug 08 14:31:47.151463 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 69/142] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:46 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:47.938196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bcb5e57a-79c5-4de2-bb54-77e6b5f2f844 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:47.938874 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bcb5e57a-79c5-4de2-bb54-77e6b5f2f844 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:47.944949 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb5e57a-79c5-4de2-bb54-77e6b5f2f844 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:47.946104 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb5e57a-79c5-4de2-bb54-77e6b5f2f844 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:47.946521 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb5e57a-79c5-4de2-bb54-77e6b5f2f844 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:47.947234 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb5e57a-79c5-4de2-bb54-77e6b5f2f844 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:47.947714 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb5e57a-79c5-4de2-bb54-77e6b5f2f844 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:47.948135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb5e57a-79c5-4de2-bb54-77e6b5f2f844 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:47.965223 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-588335c4-1cfe-4f39-98d9-e6ba7c8a91bd tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:47.965830 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-588335c4-1cfe-4f39-98d9-e6ba7c8a91bd tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:47.973228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-588335c4-1cfe-4f39-98d9-e6ba7c8a91bd tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:47.973713 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-588335c4-1cfe-4f39-98d9-e6ba7c8a91bd tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:47.974144 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-588335c4-1cfe-4f39-98d9-e6ba7c8a91bd tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:47.974857 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-588335c4-1cfe-4f39-98d9-e6ba7c8a91bd tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:47.975337 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-588335c4-1cfe-4f39-98d9-e6ba7c8a91bd tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:47.975756 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-588335c4-1cfe-4f39-98d9-e6ba7c8a91bd tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:48.144462 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bcb5e57a-79c5-4de2-bb54-77e6b5f2f844 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:48.151877 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bcb5e57a-79c5-4de2-bb54-77e6b5f2f844 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1361 microversion: 2.1 time: 0.217853 Aug 08 14:31:48.152455 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 74/143] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:47 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:48.155842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-588335c4-1cfe-4f39-98d9-e6ba7c8a91bd tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:48.164483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-588335c4-1cfe-4f39-98d9-e6ba7c8a91bd tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:48.166111 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-588335c4-1cfe-4f39-98d9-e6ba7c8a91bd tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:48.166251 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c335ae64-440d-4585-ab83-6a3407aa2b4f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:48.166717 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c335ae64-440d-4585-ab83-6a3407aa2b4f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:48.167264 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-588335c4-1cfe-4f39-98d9-e6ba7c8a91bd tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.205923 Aug 08 14:31:48.167822 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 70/144] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:47 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:31:48.172480 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0749cc5c-d07b-4fa9-9ef8-00ee2c1cbd70 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:48.173019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c335ae64-440d-4585-ab83-6a3407aa2b4f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:48.173140 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-0749cc5c-d07b-4fa9-9ef8-00ee2c1cbd70 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:48.173500 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c335ae64-440d-4585-ab83-6a3407aa2b4f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:48.174017 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c335ae64-440d-4585-ab83-6a3407aa2b4f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:48.174704 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c335ae64-440d-4585-ab83-6a3407aa2b4f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:48.175183 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c335ae64-440d-4585-ab83-6a3407aa2b4f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:48.175604 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c335ae64-440d-4585-ab83-6a3407aa2b4f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:48.182306 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0749cc5c-d07b-4fa9-9ef8-00ee2c1cbd70 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:48.182799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0749cc5c-d07b-4fa9-9ef8-00ee2c1cbd70 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:48.183266 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0749cc5c-d07b-4fa9-9ef8-00ee2c1cbd70 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:48.183964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0749cc5c-d07b-4fa9-9ef8-00ee2c1cbd70 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:48.184425 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0749cc5c-d07b-4fa9-9ef8-00ee2c1cbd70 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:48.184851 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0749cc5c-d07b-4fa9-9ef8-00ee2c1cbd70 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:48.379064 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c335ae64-440d-4585-ab83-6a3407aa2b4f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:48.387880 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c335ae64-440d-4585-ab83-6a3407aa2b4f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.225900 Aug 08 14:31:48.388454 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 75/145] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:48 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:31:48.419785 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-0749cc5c-d07b-4fa9-9ef8-00ee2c1cbd70 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:48.432051 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0749cc5c-d07b-4fa9-9ef8-00ee2c1cbd70 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1557 microversion: 2.1 time: 0.263070 Aug 08 14:31:48.432925 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 71/146] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:48 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1557 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:48.455539 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f7322aa5-b39b-4b0e-bebf-a7fa616f90f1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:48.460319 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f7322aa5-b39b-4b0e-bebf-a7fa616f90f1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:48.478525 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f7322aa5-b39b-4b0e-bebf-a7fa616f90f1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:48.479227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f7322aa5-b39b-4b0e-bebf-a7fa616f90f1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:48.479996 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f7322aa5-b39b-4b0e-bebf-a7fa616f90f1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:48.481515 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f7322aa5-b39b-4b0e-bebf-a7fa616f90f1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:48.482892 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f7322aa5-b39b-4b0e-bebf-a7fa616f90f1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:48.483522 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f7322aa5-b39b-4b0e-bebf-a7fa616f90f1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:48.619666 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f7322aa5-b39b-4b0e-bebf-a7fa616f90f1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168906 Aug 08 14:31:48.623236 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 76/147] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 14:31:48 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:49.176010 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7286d6b7-14ef-490e-b26e-a7fd859ee813 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:49.177616 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7286d6b7-14ef-490e-b26e-a7fd859ee813 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:49.187937 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7286d6b7-14ef-490e-b26e-a7fd859ee813 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:49.188719 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7286d6b7-14ef-490e-b26e-a7fd859ee813 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:49.189328 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7286d6b7-14ef-490e-b26e-a7fd859ee813 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:49.190849 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7286d6b7-14ef-490e-b26e-a7fd859ee813 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:49.194174 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-825e07f3-9396-4018-8650-1cbf59ac5e97 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:49.194174 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-825e07f3-9396-4018-8650-1cbf59ac5e97 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:49.197168 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7286d6b7-14ef-490e-b26e-a7fd859ee813 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:49.197945 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7286d6b7-14ef-490e-b26e-a7fd859ee813 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:49.205963 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-825e07f3-9396-4018-8650-1cbf59ac5e97 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:49.206462 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-825e07f3-9396-4018-8650-1cbf59ac5e97 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:49.206936 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-825e07f3-9396-4018-8650-1cbf59ac5e97 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:49.207706 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-825e07f3-9396-4018-8650-1cbf59ac5e97 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:49.208163 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-825e07f3-9396-4018-8650-1cbf59ac5e97 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:49.208589 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-825e07f3-9396-4018-8650-1cbf59ac5e97 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:49.657479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-825e07f3-9396-4018-8650-1cbf59ac5e97 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:49.668406 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-825e07f3-9396-4018-8650-1cbf59ac5e97 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:49.672283 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7286d6b7-14ef-490e-b26e-a7fd859ee813 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:49.672672 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-825e07f3-9396-4018-8650-1cbf59ac5e97 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:49.674314 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-825e07f3-9396-4018-8650-1cbf59ac5e97 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1403 microversion: 2.20 time: 0.487037 Aug 08 14:31:49.675146 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 77/148] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:49 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1403 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:49.682017 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-305d7635-ddab-43ff-92af-bf2f71c2c12f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:49.683001 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-305d7635-ddab-43ff-92af-bf2f71c2c12f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:49.685088 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7286d6b7-14ef-490e-b26e-a7fd859ee813 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1548 microversion: 2.1 time: 0.513981 Aug 08 14:31:49.685873 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 72/149] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:49 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1548 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:49.708137 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-305d7635-ddab-43ff-92af-bf2f71c2c12f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:49.708819 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-305d7635-ddab-43ff-92af-bf2f71c2c12f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:49.709486 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-305d7635-ddab-43ff-92af-bf2f71c2c12f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:49.710480 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-305d7635-ddab-43ff-92af-bf2f71c2c12f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:49.711126 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-305d7635-ddab-43ff-92af-bf2f71c2c12f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:49.711689 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-305d7635-ddab-43ff-92af-bf2f71c2c12f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:49.713274 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-29a96aa5-d4bd-4e61-b05c-61aa650fb995 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:49.714082 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-29a96aa5-d4bd-4e61-b05c-61aa650fb995 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:49.721881 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29a96aa5-d4bd-4e61-b05c-61aa650fb995 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:49.722601 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29a96aa5-d4bd-4e61-b05c-61aa650fb995 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:49.723042 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29a96aa5-d4bd-4e61-b05c-61aa650fb995 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:49.724106 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29a96aa5-d4bd-4e61-b05c-61aa650fb995 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:49.724617 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29a96aa5-d4bd-4e61-b05c-61aa650fb995 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:49.725142 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29a96aa5-d4bd-4e61-b05c-61aa650fb995 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:49.755760 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=100 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:31:50.131059 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-29a96aa5-d4bd-4e61-b05c-61aa650fb995 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.423494 Aug 08 14:31:50.140173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 73/150] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 14:31:49 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/os-interface => generated 285 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:50.250970 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-305d7635-ddab-43ff-92af-bf2f71c2c12f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:50.262375 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-305d7635-ddab-43ff-92af-bf2f71c2c12f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1314 microversion: 2.1 time: 0.585530 Aug 08 14:31:50.263396 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 78/151] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:49 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:31:50.567128 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-e0fa4ca7-ab07-4033-8991-541f63a16566 req-8cdbe8e0-c3dc-4a25-9b76-dfc65c249c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70", "tag": "18cae069-68b0-4e95-807f-a1cd956485f8"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:50.591803 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-e0fa4ca7-ab07-4033-8991-541f63a16566 req-8cdbe8e0-c3dc-4a25-9b76-dfc65c249c55 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:50.594945 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-e0fa4ca7-ab07-4033-8991-541f63a16566 req-8cdbe8e0-c3dc-4a25-9b76-dfc65c249c55 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:50.596681 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-e0fa4ca7-ab07-4033-8991-541f63a16566 req-8cdbe8e0-c3dc-4a25-9b76-dfc65c249c55 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:50.624805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-e0fa4ca7-ab07-4033-8991-541f63a16566 req-8cdbe8e0-c3dc-4a25-9b76-dfc65c249c55 service nova] Creating event network-changed:18cae069-68b0-4e95-807f-a1cd956485f8 for instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 on hv-cinder-85200 Aug 08 14:31:50.641079 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-e0fa4ca7-ab07-4033-8991-541f63a16566 req-8cdbe8e0-c3dc-4a25-9b76-dfc65c249c55 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077566 Aug 08 14:31:50.645184 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 74/152] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:50.699565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a87f87de-7d02-411b-9d2c-e606e87932f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:50.701576 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a87f87de-7d02-411b-9d2c-e606e87932f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:50.723250 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a87f87de-7d02-411b-9d2c-e606e87932f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:50.725653 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a87f87de-7d02-411b-9d2c-e606e87932f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:50.726087 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a87f87de-7d02-411b-9d2c-e606e87932f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:50.730224 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a87f87de-7d02-411b-9d2c-e606e87932f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:50.731182 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a87f87de-7d02-411b-9d2c-e606e87932f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:50.734413 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a87f87de-7d02-411b-9d2c-e606e87932f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:51.130131 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a87f87de-7d02-411b-9d2c-e606e87932f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:51.139547 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a87f87de-7d02-411b-9d2c-e606e87932f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:51.145836 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a87f87de-7d02-411b-9d2c-e606e87932f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:51.147594 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a87f87de-7d02-411b-9d2c-e606e87932f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1596 microversion: 2.20 time: 0.453471 Aug 08 14:31:51.163751 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 79/153] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:31:50 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1596 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:31:51.179598 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-15c497fb-6d60-45cd-98ef-cc72e53272b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:51.183713 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-15c497fb-6d60-45cd-98ef-cc72e53272b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:51.199850 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-15c497fb-6d60-45cd-98ef-cc72e53272b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:51.201618 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-15c497fb-6d60-45cd-98ef-cc72e53272b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:51.202098 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-15c497fb-6d60-45cd-98ef-cc72e53272b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:51.202840 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-15c497fb-6d60-45cd-98ef-cc72e53272b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:51.205232 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-15c497fb-6d60-45cd-98ef-cc72e53272b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:51.205709 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-15c497fb-6d60-45cd-98ef-cc72e53272b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:51.293630 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e0e36660-70c2-4f0f-a0dd-7b2490c6b09f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:31:51.295564 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e0e36660-70c2-4f0f-a0dd-7b2490c6b09f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:51.305226 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0e36660-70c2-4f0f-a0dd-7b2490c6b09f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:51.316277 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0e36660-70c2-4f0f-a0dd-7b2490c6b09f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:51.317350 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0e36660-70c2-4f0f-a0dd-7b2490c6b09f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:51.319262 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0e36660-70c2-4f0f-a0dd-7b2490c6b09f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:51.319758 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0e36660-70c2-4f0f-a0dd-7b2490c6b09f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:51.322408 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0e36660-70c2-4f0f-a0dd-7b2490c6b09f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:51.386788 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-15c497fb-6d60-45cd-98ef-cc72e53272b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.217975 Aug 08 14:31:51.394508 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 75/154] 10.222.0.50 () {60 vars in 1316 bytes} [Mon Aug 8 14:31:51 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-interface => generated 285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:31:51.671184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e0e36660-70c2-4f0f-a0dd-7b2490c6b09f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:31:51.684112 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e0e36660-70c2-4f0f-a0dd-7b2490c6b09f tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1501 microversion: 2.1 time: 0.404923 Aug 08 14:31:51.685113 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 80/155] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:31:51 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1501 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:31:51.995971 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-c2515294-ff8a-4d59-a8f7-652022adcd0d req-981808a5-7033-43de-a636-e13529b8c995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c76439-3c30-47b1-a13c-cee630ea057b", "tag": "354b296f-263e-4dae-87aa-7cee7e4a17bd"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:52.019961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-c2515294-ff8a-4d59-a8f7-652022adcd0d req-981808a5-7033-43de-a636-e13529b8c995 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:52.021130 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-c2515294-ff8a-4d59-a8f7-652022adcd0d req-981808a5-7033-43de-a636-e13529b8c995 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:52.023008 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-c2515294-ff8a-4d59-a8f7-652022adcd0d req-981808a5-7033-43de-a636-e13529b8c995 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:52.042882 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-c2515294-ff8a-4d59-a8f7-652022adcd0d req-981808a5-7033-43de-a636-e13529b8c995 service nova] Creating event network-changed:354b296f-263e-4dae-87aa-7cee7e4a17bd for instance b4c76439-3c30-47b1-a13c-cee630ea057b on hv-cinder-85200 Aug 08 14:31:52.057462 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-c2515294-ff8a-4d59-a8f7-652022adcd0d req-981808a5-7033-43de-a636-e13529b8c995 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063525 Aug 08 14:31:52.062324 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 76/156] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:31:52.914684 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-33b9105b-cdae-4cf2-bff9-e1d32be1f0fc req-72f6b14f-51bc-45f4-bbb3-686ebe29882c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0245e7-b0d0-4fbe-a233-4b3e7768b94c", "tag": "87f964c5-59f7-49fd-885c-ebcb610ccd3e"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:52.925620 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-33b9105b-cdae-4cf2-bff9-e1d32be1f0fc req-72f6b14f-51bc-45f4-bbb3-686ebe29882c service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:52.926273 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-33b9105b-cdae-4cf2-bff9-e1d32be1f0fc req-72f6b14f-51bc-45f4-bbb3-686ebe29882c service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:52.926848 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-33b9105b-cdae-4cf2-bff9-e1d32be1f0fc req-72f6b14f-51bc-45f4-bbb3-686ebe29882c service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:52.940566 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-33b9105b-cdae-4cf2-bff9-e1d32be1f0fc req-72f6b14f-51bc-45f4-bbb3-686ebe29882c service nova] Creating event network-changed:87f964c5-59f7-49fd-885c-ebcb610ccd3e for instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c on hv-cinder-85200 Aug 08 14:31:52.947749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-33b9105b-cdae-4cf2-bff9-e1d32be1f0fc req-72f6b14f-51bc-45f4-bbb3-686ebe29882c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037331 Aug 08 14:31:52.948655 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 81/157] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:31:54.392807 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-759d8a2c-46d1-45b6-a45f-3f85533fb95a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73a24f44-55db-4c75-b29e-7b94307136fe"}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:31:54.402411 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-759d8a2c-46d1-45b6-a45f-3f85533fb95a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:31:54.413156 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-759d8a2c-46d1-45b6-a45f-3f85533fb95a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:54.415485 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-759d8a2c-46d1-45b6-a45f-3f85533fb95a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:54.416195 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-759d8a2c-46d1-45b6-a45f-3f85533fb95a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:54.417340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-759d8a2c-46d1-45b6-a45f-3f85533fb95a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:31:54.417981 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-759d8a2c-46d1-45b6-a45f-3f85533fb95a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:31:54.418702 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-759d8a2c-46d1-45b6-a45f-3f85533fb95a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:31:55.206385 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-759d8a2c-46d1-45b6-a45f-3f85533fb95a tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "POST /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.818913 Aug 08 14:31:55.223564 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 77/158] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 14:31:54 2022] POST /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a/os-volume_attachments => generated 194 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:03.184121 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=83 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:03.185295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=96 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:03.191670 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1952156966", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "networks": [{"uuid": "d21c9477-68f6-4e32-8832-8c0d67e51ed7"}]}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:03.308899 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] validate_networks() for [('d21c9477-68f6-4e32-8832-8c0d67e51ed7', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:32:04.036817 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:32:04.037415 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:32:04.037846 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:32:04.038445 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:32:04.038944 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:32:04.061984 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:04.062474 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:04.062906 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:04.071859 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:04.072356 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:04.072796 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:04.119849 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Getting quotas for project d6dae806b3c14f3fa1d2a491214de9f8. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:32:04.126020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Getting quotas for user c29b21ee2cd341169a2c8263393c5db6 and project d6dae806b3c14f3fa1d2a491214de9f8. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:32:04.160564 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:32:04.168126 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:32:04.292818 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e39aaf11-29f8-492f-bbbe-c7e47ecd918e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110620 Aug 08 14:32:04.306087 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 82/159] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:32:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:32:04.326730 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8be7e0f3-645f-4a19-a3b9-250b2085d4c8 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:04.327573 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8be7e0f3-645f-4a19-a3b9-250b2085d4c8 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:04.335733 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=82 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:04.471644 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8be7e0f3-645f-4a19-a3b9-250b2085d4c8 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:04.482593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8be7e0f3-645f-4a19-a3b9-250b2085d4c8 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1214 microversion: 2.1 time: 0.180758 Aug 08 14:32:04.484115 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 78/160] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:04 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:05.514187 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-32ad02e9-1f1e-4e0d-861a-83b970fc04c8 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:05.514620 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-32ad02e9-1f1e-4e0d-861a-83b970fc04c8 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:05.530163 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-32ad02e9-1f1e-4e0d-861a-83b970fc04c8 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:05.532165 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-32ad02e9-1f1e-4e0d-861a-83b970fc04c8 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:05.532854 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-32ad02e9-1f1e-4e0d-861a-83b970fc04c8 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:05.534715 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-32ad02e9-1f1e-4e0d-861a-83b970fc04c8 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:05.536259 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-32ad02e9-1f1e-4e0d-861a-83b970fc04c8 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:05.536908 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-32ad02e9-1f1e-4e0d-861a-83b970fc04c8 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:05.709300 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-32ad02e9-1f1e-4e0d-861a-83b970fc04c8 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:05.727028 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:05.731908 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-32ad02e9-1f1e-4e0d-861a-83b970fc04c8 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1218 microversion: 2.1 time: 0.225149 Aug 08 14:32:05.732502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 83/161] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:05 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1218 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:06.084687 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-cdba0ed9-5aeb-4910-9d35-5eece246fe00 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Action: 'create', calling method: .version_select at 0x7f9cb27ef4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1484870203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOQNzz8DPPGgrYQj1CjYEE4pDtiHbcOes2I1TENzetxI2W6dwguKGc1Dl4v+uUyby3cx0i2gBHmh7CeVz4nigyy7XZ7d2782UyMVzOL1nD9fl7FVT7QlIbT8ieprqBoIQ=="}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:06.101925 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-cdba0ed9-5aeb-4910-9d35-5eece246fe00 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Getting quotas for project 8aac3d3b720c45e8817bda1fe4d2d157. Resources: {'key_pairs'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:32:06.106112 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-cdba0ed9-5aeb-4910-9d35-5eece246fe00 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Getting quotas for user 2495d3c63dc44049872afb908ca6133b and project 8aac3d3b720c45e8817bda1fe4d2d157. Resources: {'key_pairs'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:32:06.138329 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-cdba0ed9-5aeb-4910-9d35-5eece246fe00 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.416168 Aug 08 14:32:06.139630 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 79/162] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 14:32:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:06.758529 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1f282c5e-4c98-4e57-9c2d-b9263c0ddd99 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:06.759359 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1f282c5e-4c98-4e57-9c2d-b9263c0ddd99 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:06.768379 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f282c5e-4c98-4e57-9c2d-b9263c0ddd99 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:06.769184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f282c5e-4c98-4e57-9c2d-b9263c0ddd99 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:06.771146 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f282c5e-4c98-4e57-9c2d-b9263c0ddd99 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:06.772223 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f282c5e-4c98-4e57-9c2d-b9263c0ddd99 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:06.772874 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f282c5e-4c98-4e57-9c2d-b9263c0ddd99 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:06.774018 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f282c5e-4c98-4e57-9c2d-b9263c0ddd99 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:06.890574 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1f282c5e-4c98-4e57-9c2d-b9263c0ddd99 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:06.900291 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1f282c5e-4c98-4e57-9c2d-b9263c0ddd99 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1218 microversion: 2.1 time: 0.147376 Aug 08 14:32:06.915840 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 84/163] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:06 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:07.921579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-58d5a153-d72d-426c-a42a-792b7048c7df tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:07.922197 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-58d5a153-d72d-426c-a42a-792b7048c7df tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:07.932630 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-58d5a153-d72d-426c-a42a-792b7048c7df tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:07.933359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-58d5a153-d72d-426c-a42a-792b7048c7df tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:07.934538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-58d5a153-d72d-426c-a42a-792b7048c7df tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:07.936183 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-58d5a153-d72d-426c-a42a-792b7048c7df tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:07.936991 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-58d5a153-d72d-426c-a42a-792b7048c7df tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:07.937962 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-58d5a153-d72d-426c-a42a-792b7048c7df tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:08.033081 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-58d5a153-d72d-426c-a42a-792b7048c7df tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:08.041926 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-58d5a153-d72d-426c-a42a-792b7048c7df tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1266 microversion: 2.1 time: 0.124899 Aug 08 14:32:08.050682 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 80/164] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:07 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:08.693115 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1a0b25a1-c5b4-4e18-839d-ca0e07b60a22 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:08.694351 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1a0b25a1-c5b4-4e18-839d-ca0e07b60a22 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:08.704191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0b25a1-c5b4-4e18-839d-ca0e07b60a22 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:08.704943 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0b25a1-c5b4-4e18-839d-ca0e07b60a22 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:08.725131 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0b25a1-c5b4-4e18-839d-ca0e07b60a22 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:08.726452 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0b25a1-c5b4-4e18-839d-ca0e07b60a22 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:08.728379 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0b25a1-c5b4-4e18-839d-ca0e07b60a22 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:08.729101 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0b25a1-c5b4-4e18-839d-ca0e07b60a22 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:08.769200 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1a0b25a1-c5b4-4e18-839d-ca0e07b60a22 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:32:08.909243 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1a0b25a1-c5b4-4e18-839d-ca0e07b60a22 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 204 len: 0 microversion: 2.1 time: 0.221237 Aug 08 14:32:08.913439 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 85/165] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:32:08 2022] DELETE /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:32:08.923696 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-234270e9-9877-4496-9c05-6198ce7d7df9 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:08.924406 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-234270e9-9877-4496-9c05-6198ce7d7df9 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:08.932867 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-234270e9-9877-4496-9c05-6198ce7d7df9 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:08.933450 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-234270e9-9877-4496-9c05-6198ce7d7df9 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:08.934539 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-234270e9-9877-4496-9c05-6198ce7d7df9 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:08.935706 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-234270e9-9877-4496-9c05-6198ce7d7df9 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:08.936245 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-234270e9-9877-4496-9c05-6198ce7d7df9 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:08.936868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-234270e9-9877-4496-9c05-6198ce7d7df9 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:09.071991 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a1142500-3154-45b5-be66-62d910cf2ad3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:09.072668 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a1142500-3154-45b5-be66-62d910cf2ad3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:09.084089 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1142500-3154-45b5-be66-62d910cf2ad3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:09.084848 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1142500-3154-45b5-be66-62d910cf2ad3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:09.085441 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1142500-3154-45b5-be66-62d910cf2ad3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:09.087549 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1142500-3154-45b5-be66-62d910cf2ad3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:09.088369 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1142500-3154-45b5-be66-62d910cf2ad3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:09.089145 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1142500-3154-45b5-be66-62d910cf2ad3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:09.227389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-234270e9-9877-4496-9c05-6198ce7d7df9 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:09.240882 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-234270e9-9877-4496-9c05-6198ce7d7df9 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1553 microversion: 2.1 time: 0.325143 Aug 08 14:32:09.244192 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 81/166] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:08 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1553 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:09.345930 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a1142500-3154-45b5-be66-62d910cf2ad3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:09.368116 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a1142500-3154-45b5-be66-62d910cf2ad3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1314 microversion: 2.1 time: 0.302307 Aug 08 14:32:09.368993 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 86/167] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:09 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:10.269848 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2c7f5b02-da00-4569-8bf6-176f1fb6c0f7 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:10.269848 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2c7f5b02-da00-4569-8bf6-176f1fb6c0f7 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:10.272539 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2c7f5b02-da00-4569-8bf6-176f1fb6c0f7 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:10.273012 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2c7f5b02-da00-4569-8bf6-176f1fb6c0f7 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:10.273478 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2c7f5b02-da00-4569-8bf6-176f1fb6c0f7 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:10.274204 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2c7f5b02-da00-4569-8bf6-176f1fb6c0f7 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:10.274663 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2c7f5b02-da00-4569-8bf6-176f1fb6c0f7 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:10.275119 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2c7f5b02-da00-4569-8bf6-176f1fb6c0f7 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:10.389926 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8c489e8b-3717-465c-b5f0-a111b0904750 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:10.390696 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8c489e8b-3717-465c-b5f0-a111b0904750 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:10.400431 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8c489e8b-3717-465c-b5f0-a111b0904750 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:10.401257 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8c489e8b-3717-465c-b5f0-a111b0904750 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:10.401805 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8c489e8b-3717-465c-b5f0-a111b0904750 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:10.402821 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8c489e8b-3717-465c-b5f0-a111b0904750 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:10.403577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8c489e8b-3717-465c-b5f0-a111b0904750 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:10.404366 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8c489e8b-3717-465c-b5f0-a111b0904750 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:10.446993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2c7f5b02-da00-4569-8bf6-176f1fb6c0f7 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:10.457081 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2c7f5b02-da00-4569-8bf6-176f1fb6c0f7 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1553 microversion: 2.1 time: 0.195848 Aug 08 14:32:10.470982 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 82/168] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:10 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:10.980406 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8c489e8b-3717-465c-b5f0-a111b0904750 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:10.992744 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8c489e8b-3717-465c-b5f0-a111b0904750 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1314 microversion: 2.1 time: 0.607067 Aug 08 14:32:10.993731 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 87/169] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:10 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:11.477733 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6d018fe1-1ad2-4de8-8a0d-e12c9e6ecec5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:11.478175 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6d018fe1-1ad2-4de8-8a0d-e12c9e6ecec5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:11.503620 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d018fe1-1ad2-4de8-8a0d-e12c9e6ecec5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:11.504346 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d018fe1-1ad2-4de8-8a0d-e12c9e6ecec5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:11.504682 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d018fe1-1ad2-4de8-8a0d-e12c9e6ecec5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:11.505787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d018fe1-1ad2-4de8-8a0d-e12c9e6ecec5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:11.506309 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d018fe1-1ad2-4de8-8a0d-e12c9e6ecec5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:11.506720 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d018fe1-1ad2-4de8-8a0d-e12c9e6ecec5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:11.851569 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6d018fe1-1ad2-4de8-8a0d-e12c9e6ecec5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:11.855240 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6d018fe1-1ad2-4de8-8a0d-e12c9e6ecec5 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1553 microversion: 2.1 time: 0.381438 Aug 08 14:32:11.856289 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 83/170] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:11 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1553 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:11.990997 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-161e91d4-6732-439c-9110-3c78e60ba82f req-d64e2d12-7157-4fbb-a6f1-efda63ffd900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b8d431-87ce-4ca7-93c3-e636c05fdf63", "tag": "15fff200-264e-4d97-9216-236356507e2a"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:12.022914 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-00ba6a79-3608-4d41-bb4a-a09aec6a589d tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:12.023670 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-00ba6a79-3608-4d41-bb4a-a09aec6a589d tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:12.046477 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-00ba6a79-3608-4d41-bb4a-a09aec6a589d tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:12.047501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-00ba6a79-3608-4d41-bb4a-a09aec6a589d tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:12.048138 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-00ba6a79-3608-4d41-bb4a-a09aec6a589d tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:12.049075 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-00ba6a79-3608-4d41-bb4a-a09aec6a589d tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:12.052420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-161e91d4-6732-439c-9110-3c78e60ba82f req-d64e2d12-7157-4fbb-a6f1-efda63ffd900 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:12.054032 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-00ba6a79-3608-4d41-bb4a-a09aec6a589d tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:12.054164 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-161e91d4-6732-439c-9110-3c78e60ba82f req-d64e2d12-7157-4fbb-a6f1-efda63ffd900 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:12.055317 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-00ba6a79-3608-4d41-bb4a-a09aec6a589d tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:12.057414 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-161e91d4-6732-439c-9110-3c78e60ba82f req-d64e2d12-7157-4fbb-a6f1-efda63ffd900 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:12.084629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-161e91d4-6732-439c-9110-3c78e60ba82f req-d64e2d12-7157-4fbb-a6f1-efda63ffd900 service nova] Creating event network-changed:15fff200-264e-4d97-9216-236356507e2a for instance 96b8d431-87ce-4ca7-93c3-e636c05fdf63 on hv-cinder-85200 Aug 08 14:32:12.097648 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-161e91d4-6732-439c-9110-3c78e60ba82f req-d64e2d12-7157-4fbb-a6f1-efda63ffd900 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120374 Aug 08 14:32:12.098678 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 88/171] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:12.625193 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-00ba6a79-3608-4d41-bb4a-a09aec6a589d tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:12.639567 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-00ba6a79-3608-4d41-bb4a-a09aec6a589d tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1314 microversion: 2.1 time: 0.626750 Aug 08 14:32:12.640168 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 84/172] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:12 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:12.885664 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-590137de-eca9-487c-808d-52504b74f9b8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:12.886952 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-590137de-eca9-487c-808d-52504b74f9b8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:12.894472 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-590137de-eca9-487c-808d-52504b74f9b8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:12.895794 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-590137de-eca9-487c-808d-52504b74f9b8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:12.896315 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-590137de-eca9-487c-808d-52504b74f9b8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:12.897267 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-590137de-eca9-487c-808d-52504b74f9b8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:12.897977 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-590137de-eca9-487c-808d-52504b74f9b8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:12.898500 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-590137de-eca9-487c-808d-52504b74f9b8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:12.973335 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-590137de-eca9-487c-808d-52504b74f9b8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:12.981956 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-590137de-eca9-487c-808d-52504b74f9b8 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1345 microversion: 2.1 time: 0.108568 Aug 08 14:32:12.982531 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 89/173] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:12 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:13.660591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b597ba4c-a49b-472d-9141-cad505e42ed5 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:13.670751 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b597ba4c-a49b-472d-9141-cad505e42ed5 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:13.678349 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b597ba4c-a49b-472d-9141-cad505e42ed5 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:13.679706 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b597ba4c-a49b-472d-9141-cad505e42ed5 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:13.680290 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b597ba4c-a49b-472d-9141-cad505e42ed5 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:13.681146 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b597ba4c-a49b-472d-9141-cad505e42ed5 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:13.681600 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b597ba4c-a49b-472d-9141-cad505e42ed5 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:13.682025 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b597ba4c-a49b-472d-9141-cad505e42ed5 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:13.833766 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b597ba4c-a49b-472d-9141-cad505e42ed5 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:13.843234 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b597ba4c-a49b-472d-9141-cad505e42ed5 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1314 microversion: 2.1 time: 0.186386 Aug 08 14:32:13.843718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 85/174] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:13 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:14.009120 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e950ed25-5526-4b66-8347-578956b2c89b tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:14.010123 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e950ed25-5526-4b66-8347-578956b2c89b tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:14.022344 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e950ed25-5526-4b66-8347-578956b2c89b tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:14.023017 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e950ed25-5526-4b66-8347-578956b2c89b tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:14.023821 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e950ed25-5526-4b66-8347-578956b2c89b tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:14.024593 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e950ed25-5526-4b66-8347-578956b2c89b tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:14.025187 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e950ed25-5526-4b66-8347-578956b2c89b tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:14.025677 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e950ed25-5526-4b66-8347-578956b2c89b tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:14.098171 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:14.111394 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e950ed25-5526-4b66-8347-578956b2c89b tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:14.111972 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e950ed25-5526-4b66-8347-578956b2c89b tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:14.113244 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e950ed25-5526-4b66-8347-578956b2c89b tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:14.118021 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-e950ed25-5526-4b66-8347-578956b2c89b tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lazy-loading 'fault' on Instance uuid fdd0ce81-8365-4812-b309-d3d873311c3a {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:32:14.139622 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=6 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:14.139823 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-ef5b3e93-c93e-4b1c-9d0b-b651c78e7898 req-d8ae89fb-ad57-4844-ad64-658048699b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd0ce81-8365-4812-b309-d3d873311c3a", "name": "network-vif-deleted", "tag": "496b1c03-1e52-4f57-bbae-16f42a9a9f5c"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:14.152885 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-ef5b3e93-c93e-4b1c-9d0b-b651c78e7898 req-d8ae89fb-ad57-4844-ad64-658048699b48 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:14.153745 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-ef5b3e93-c93e-4b1c-9d0b-b651c78e7898 req-d8ae89fb-ad57-4844-ad64-658048699b48 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:14.154086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-ef5b3e93-c93e-4b1c-9d0b-b651c78e7898 req-d8ae89fb-ad57-4844-ad64-658048699b48 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:14.168484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-ef5b3e93-c93e-4b1c-9d0b-b651c78e7898 req-d8ae89fb-ad57-4844-ad64-658048699b48 service nova] Creating event network-vif-deleted:496b1c03-1e52-4f57-bbae-16f42a9a9f5c for instance fdd0ce81-8365-4812-b309-d3d873311c3a on hv-cinder-85200 Aug 08 14:32:14.174468 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e950ed25-5526-4b66-8347-578956b2c89b tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c71ba6b2ad438d8593fa19eb617a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cfe2f487fc4393bda828dc28471dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:14.174861 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-ef5b3e93-c93e-4b1c-9d0b-b651c78e7898 req-d8ae89fb-ad57-4844-ad64-658048699b48 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041487 Aug 08 14:32:14.175755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 86/175] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:14.186674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e950ed25-5526-4b66-8347-578956b2c89b tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 200 len: 1350 microversion: 2.1 time: 0.183906 Aug 08 14:32:14.191848 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 90/176] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:13 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 1350 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:14.867350 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-fc8600fc-84b2-4cee-8b2c-87189e9cb18c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:14.868914 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-fc8600fc-84b2-4cee-8b2c-87189e9cb18c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:14.876445 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fc8600fc-84b2-4cee-8b2c-87189e9cb18c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:14.876928 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fc8600fc-84b2-4cee-8b2c-87189e9cb18c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:14.877642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fc8600fc-84b2-4cee-8b2c-87189e9cb18c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:14.880616 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fc8600fc-84b2-4cee-8b2c-87189e9cb18c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:14.880704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fc8600fc-84b2-4cee-8b2c-87189e9cb18c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:14.881120 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fc8600fc-84b2-4cee-8b2c-87189e9cb18c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:15.021677 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-fc8600fc-84b2-4cee-8b2c-87189e9cb18c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:15.031613 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-fc8600fc-84b2-4cee-8b2c-87189e9cb18c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1314 microversion: 2.1 time: 0.170362 Aug 08 14:32:15.032688 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 87/177] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:14 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:15.208640 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f0fe703e-fba3-4041-a8b8-a8a0ae0d1db0 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:15.209258 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f0fe703e-fba3-4041-a8b8-a8a0ae0d1db0 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:15.218126 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f0fe703e-fba3-4041-a8b8-a8a0ae0d1db0 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:15.218610 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f0fe703e-fba3-4041-a8b8-a8a0ae0d1db0 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:15.219053 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f0fe703e-fba3-4041-a8b8-a8a0ae0d1db0 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:15.219770 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f0fe703e-fba3-4041-a8b8-a8a0ae0d1db0 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:15.220226 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f0fe703e-fba3-4041-a8b8-a8a0ae0d1db0 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:15.220642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f0fe703e-fba3-4041-a8b8-a8a0ae0d1db0 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:15.240745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-f0fe703e-fba3-4041-a8b8-a8a0ae0d1db0 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] HTTP exception thrown: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f0fe703e-fba3-4041-a8b8-a8a0ae0d1db0 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Request method failure captured: Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a HTTP/1.1 Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4n5CUxemLtfJm-xjw8U4vIeqBA82yR1Bul5_0kZQGr4uveJhk9JaoAS9UE7BCTRoSVWzi-aw0MiCXdNXlv8D-kExsnsZsZjUqyzbCeQ_wD2TP8rlQ1lA64i3WSq_oWaDVoUP2LDSMjcjUWoo4lbmSPJUlYy19X81asj7lq05HFHyY Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 82cfe2f487fc4393bda828dc28471dca Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-DeleteServersTestJSON-563334935 Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:32:15.247133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:32:15.248558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/82cfe2f487fc4393bda828dc28471dca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_82cfe2f487fc4393bda828dc28471dca", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/82cfe2f487fc4393bda828dc28471dca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/82cfe2f487fc4393bda828dc28471dca"}]}] Aug 08 14:32:15.248558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-DeleteServersTestJSON-563334935 Aug 08 14:32:15.248558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 82cfe2f487fc4393bda828dc28471dca Aug 08 14:32:15.248558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-DeleteServersTestJSON-563334935 Aug 08 14:32:15.248558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-DeleteServersTestJSON-563334935-project Aug 08 14:32:15.248558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:32:15.248558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:32:15.248558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 33c71ba6b2ad438d8593fa19eb617a34 Aug 08 14:32:15.248558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-DeleteServersTestJSON-563334935-project Aug 08 14:32:15.248558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:32:15.248558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:15.248558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'fdd0ce81-8365-4812-b309-d3d873311c3a'} Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:32:15.249347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:15.250450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:15.252766 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f0fe703e-fba3-4041-a8b8-a8a0ae0d1db0 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Returning 404 to user: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:32:15.253808 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f0fe703e-fba3-4041-a8b8-a8a0ae0d1db0 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 404 len: 111 microversion: 2.1 time: 0.049145 Aug 08 14:32:15.254837 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 91/178] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:15 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:32:15.408981 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4152cf14-1795-441f-9e6a-1b62833f469c tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:15.411724 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-4152cf14-1795-441f-9e6a-1b62833f469c tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:15.418212 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4152cf14-1795-441f-9e6a-1b62833f469c tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:15.419128 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4152cf14-1795-441f-9e6a-1b62833f469c tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:15.419672 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4152cf14-1795-441f-9e6a-1b62833f469c tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:15.431606 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4152cf14-1795-441f-9e6a-1b62833f469c tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:15.431606 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4152cf14-1795-441f-9e6a-1b62833f469c tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:15.431606 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4152cf14-1795-441f-9e6a-1b62833f469c tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:15.440442 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-4152cf14-1795-441f-9e6a-1b62833f469c tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] HTTP exception thrown: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4152cf14-1795-441f-9e6a-1b62833f469c tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Request method failure captured: Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a/os-volume_attachments HTTP/1.1 Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4n5CUxemLtfJm-xjw8U4vIeqBA82yR1Bul5_0kZQGr4uveJhk9JaoAS9UE7BCTRoSVWzi-aw0MiCXdNXlv8D-kExsnsZsZjUqyzbCeQ_wD2TP8rlQ1lA64i3WSq_oWaDVoUP2LDSMjcjUWoo4lbmSPJUlYy19X81asj7lq05HFHyY Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 82cfe2f487fc4393bda828dc28471dca Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-DeleteServersTestJSON-563334935 Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:32:15.444983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:32:15.446708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/82cfe2f487fc4393bda828dc28471dca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_82cfe2f487fc4393bda828dc28471dca", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/82cfe2f487fc4393bda828dc28471dca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/82cfe2f487fc4393bda828dc28471dca"}]}] Aug 08 14:32:15.446708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-DeleteServersTestJSON-563334935 Aug 08 14:32:15.446708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 82cfe2f487fc4393bda828dc28471dca Aug 08 14:32:15.446708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-DeleteServersTestJSON-563334935 Aug 08 14:32:15.446708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-DeleteServersTestJSON-563334935-project Aug 08 14:32:15.446708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:32:15.446708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:32:15.446708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 33c71ba6b2ad438d8593fa19eb617a34 Aug 08 14:32:15.446708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-DeleteServersTestJSON-563334935-project Aug 08 14:32:15.446708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:32:15.446708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:15.446708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'server_id': 'fdd0ce81-8365-4812-b309-d3d873311c3a'} Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:32:15.447389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:15.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:15.452867 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4152cf14-1795-441f-9e6a-1b62833f469c tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Returning 404 to user: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:32:15.452867 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-4152cf14-1795-441f-9e6a-1b62833f469c tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043529 Aug 08 14:32:15.452867 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 88/179] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:32:15 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:32:16.055808 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-25086dd9-d06d-41ae-a584-ceeb0090c0fb tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:16.056741 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-25086dd9-d06d-41ae-a584-ceeb0090c0fb tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:16.063043 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25086dd9-d06d-41ae-a584-ceeb0090c0fb tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:16.063558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25086dd9-d06d-41ae-a584-ceeb0090c0fb tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:16.063986 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25086dd9-d06d-41ae-a584-ceeb0090c0fb tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:16.064729 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25086dd9-d06d-41ae-a584-ceeb0090c0fb tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:16.065397 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25086dd9-d06d-41ae-a584-ceeb0090c0fb tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:16.065816 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25086dd9-d06d-41ae-a584-ceeb0090c0fb tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:16.206187 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-25086dd9-d06d-41ae-a584-ceeb0090c0fb tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:16.214087 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-25086dd9-d06d-41ae-a584-ceeb0090c0fb tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1314 microversion: 2.1 time: 0.164636 Aug 08 14:32:16.214699 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 92/180] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:16 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:16.694846 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a58f1fe2-7b51-4abe-a18a-ab3e2b0ff762 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:16.695969 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-a58f1fe2-7b51-4abe-a18a-ab3e2b0ff762 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:16.698367 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=6 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:16.703952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a58f1fe2-7b51-4abe-a18a-ab3e2b0ff762 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:16.704421 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a58f1fe2-7b51-4abe-a18a-ab3e2b0ff762 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:16.704856 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a58f1fe2-7b51-4abe-a18a-ab3e2b0ff762 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:16.705881 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a58f1fe2-7b51-4abe-a18a-ab3e2b0ff762 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:16.706527 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a58f1fe2-7b51-4abe-a18a-ab3e2b0ff762 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:16.707389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a58f1fe2-7b51-4abe-a18a-ab3e2b0ff762 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:16.726388 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-a58f1fe2-7b51-4abe-a18a-ab3e2b0ff762 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] HTTP exception thrown: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a58f1fe2-7b51-4abe-a18a-ab3e2b0ff762 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Request method failure captured: Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: DELETE /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a HTTP/1.1 Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4n5CUxemLtfJm-xjw8U4vIeqBA82yR1Bul5_0kZQGr4uveJhk9JaoAS9UE7BCTRoSVWzi-aw0MiCXdNXlv8D-kExsnsZsZjUqyzbCeQ_wD2TP8rlQ1lA64i3WSq_oWaDVoUP2LDSMjcjUWoo4lbmSPJUlYy19X81asj7lq05HFHyY Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 82cfe2f487fc4393bda828dc28471dca Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-DeleteServersTestJSON-563334935 Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:32:16.730348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:32:16.731514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/82cfe2f487fc4393bda828dc28471dca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_82cfe2f487fc4393bda828dc28471dca", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/82cfe2f487fc4393bda828dc28471dca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/82cfe2f487fc4393bda828dc28471dca"}]}] Aug 08 14:32:16.731514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-DeleteServersTestJSON-563334935 Aug 08 14:32:16.731514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 82cfe2f487fc4393bda828dc28471dca Aug 08 14:32:16.731514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-DeleteServersTestJSON-563334935 Aug 08 14:32:16.731514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-DeleteServersTestJSON-563334935-project Aug 08 14:32:16.731514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:32:16.731514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:32:16.731514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 33c71ba6b2ad438d8593fa19eb617a34 Aug 08 14:32:16.731514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-DeleteServersTestJSON-563334935-project Aug 08 14:32:16.731514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:32:16.731514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:16.731514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': 'fdd0ce81-8365-4812-b309-d3d873311c3a'} Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:32:16.732170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:16.733250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:16.734272 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a58f1fe2-7b51-4abe-a18a-ab3e2b0ff762 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Returning 404 to user: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:32:16.734272 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-a58f1fe2-7b51-4abe-a18a-ab3e2b0ff762 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 404 len: 111 microversion: 2.1 time: 0.040998 Aug 08 14:32:16.734272 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 89/181] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:32:16 2022] DELETE /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:32:16.741439 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-58d467d4-3d96-4801-8f6e-f3601f9a1cb4 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:16.742378 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-58d467d4-3d96-4801-8f6e-f3601f9a1cb4 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] [instance: fdd0ce81-8365-4812-b309-d3d873311c3a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:16.750121 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58d467d4-3d96-4801-8f6e-f3601f9a1cb4 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:16.751504 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58d467d4-3d96-4801-8f6e-f3601f9a1cb4 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:16.752803 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58d467d4-3d96-4801-8f6e-f3601f9a1cb4 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:16.753597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58d467d4-3d96-4801-8f6e-f3601f9a1cb4 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:16.754586 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58d467d4-3d96-4801-8f6e-f3601f9a1cb4 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:16.759765 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58d467d4-3d96-4801-8f6e-f3601f9a1cb4 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:16.784038 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-58d467d4-3d96-4801-8f6e-f3601f9a1cb4 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] HTTP exception thrown: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-58d467d4-3d96-4801-8f6e-f3601f9a1cb4 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Request method failure captured: Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a HTTP/1.1 Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4n5CUxemLtfJm-xjw8U4vIeqBA82yR1Bul5_0kZQGr4uveJhk9JaoAS9UE7BCTRoSVWzi-aw0MiCXdNXlv8D-kExsnsZsZjUqyzbCeQ_wD2TP8rlQ1lA64i3WSq_oWaDVoUP2LDSMjcjUWoo4lbmSPJUlYy19X81asj7lq05HFHyY Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 82cfe2f487fc4393bda828dc28471dca Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-DeleteServersTestJSON-563334935 Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:32:16.788318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:32:16.789693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/82cfe2f487fc4393bda828dc28471dca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_82cfe2f487fc4393bda828dc28471dca", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/82cfe2f487fc4393bda828dc28471dca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/82cfe2f487fc4393bda828dc28471dca"}]}] Aug 08 14:32:16.789693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-DeleteServersTestJSON-563334935 Aug 08 14:32:16.789693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 82cfe2f487fc4393bda828dc28471dca Aug 08 14:32:16.789693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-DeleteServersTestJSON-563334935 Aug 08 14:32:16.789693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-DeleteServersTestJSON-563334935-project Aug 08 14:32:16.789693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:32:16.789693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:32:16.789693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 33c71ba6b2ad438d8593fa19eb617a34 Aug 08 14:32:16.789693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-DeleteServersTestJSON-563334935-project Aug 08 14:32:16.789693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:32:16.789693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:16.789693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'fdd0ce81-8365-4812-b309-d3d873311c3a'} Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:32:16.790324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. Aug 08 14:32:16.791420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:16.792348 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-58d467d4-3d96-4801-8f6e-f3601f9a1cb4 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] Returning 404 to user: Instance fdd0ce81-8365-4812-b309-d3d873311c3a could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:32:16.792694 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-58d467d4-3d96-4801-8f6e-f3601f9a1cb4 tempest-DeleteServersTestJSON-563334935 tempest-DeleteServersTestJSON-563334935-project] 10.222.0.50 "GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a" status: 404 len: 111 microversion: 2.1 time: 0.055634 Aug 08 14:32:16.793266 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 93/182] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:16 2022] GET /compute/v2.1/servers/fdd0ce81-8365-4812-b309-d3d873311c3a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:32:17.235209 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bebb0a94-f208-4869-ab85-b7128e925259 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:17.235738 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bebb0a94-f208-4869-ab85-b7128e925259 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:17.241794 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bebb0a94-f208-4869-ab85-b7128e925259 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:17.242761 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bebb0a94-f208-4869-ab85-b7128e925259 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:17.243218 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bebb0a94-f208-4869-ab85-b7128e925259 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:17.243915 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bebb0a94-f208-4869-ab85-b7128e925259 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:17.244365 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bebb0a94-f208-4869-ab85-b7128e925259 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:17.244787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bebb0a94-f208-4869-ab85-b7128e925259 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:17.513759 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bebb0a94-f208-4869-ab85-b7128e925259 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:17.516909 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-7bb20d77-c029-4cc0-aa70-47eaeba6b277 req-1ce7c347-28f0-4bb7-8893-b46504b2db81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b8d431-87ce-4ca7-93c3-e636c05fdf63", "name": "network-vif-plugged", "status": "completed", "tag": "15fff200-264e-4d97-9216-236356507e2a"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:17.526689 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bebb0a94-f208-4869-ab85-b7128e925259 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1314 microversion: 2.1 time: 0.295043 Aug 08 14:32:17.535633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-7bb20d77-c029-4cc0-aa70-47eaeba6b277 req-1ce7c347-28f0-4bb7-8893-b46504b2db81 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:17.536374 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-7bb20d77-c029-4cc0-aa70-47eaeba6b277 req-1ce7c347-28f0-4bb7-8893-b46504b2db81 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:17.537094 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-7bb20d77-c029-4cc0-aa70-47eaeba6b277 req-1ce7c347-28f0-4bb7-8893-b46504b2db81 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:17.540256 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 90/183] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:17 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:17.556332 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-7bb20d77-c029-4cc0-aa70-47eaeba6b277 req-1ce7c347-28f0-4bb7-8893-b46504b2db81 service nova] Creating event network-vif-plugged:15fff200-264e-4d97-9216-236356507e2a for instance 96b8d431-87ce-4ca7-93c3-e636c05fdf63 on hv-cinder-85200 Aug 08 14:32:17.561892 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-7bb20d77-c029-4cc0-aa70-47eaeba6b277 req-1ce7c347-28f0-4bb7-8893-b46504b2db81 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050922 Aug 08 14:32:17.562774 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 94/184] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:32:17.913380 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-644335332", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452"}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:17.985925 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.network.neutron [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] validate_networks() for None {{(pid=118062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:32:18.378990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Flavor limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:32:18.379483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Image limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:32:18.380259 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Flavor pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:32:18.380732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Image pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:32:18.381093 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:32:18.391621 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:18.392488 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:18.392925 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:18.393668 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:18.394127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:18.394610 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:18.414875 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Getting quotas for project e6551ae647e5470e971bfa089afc10e4. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:32:18.419583 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Getting quotas for user 2414021316e24ff887ce3472689b7d51 and project e6551ae647e5470e971bfa089afc10e4. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:32:18.430820 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Going to run 1 instances... {{(pid=118062) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:32:18.433325 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:32:18.493705 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-cdc37b40-76ba-4492-8c90-7c93f0bb4040 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585658 Aug 08 14:32:18.494726 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 91/185] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:32:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:32:18.506753 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bb29939c-3187-4694-abbd-309e65ff6f1f tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:18.507573 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bb29939c-3187-4694-abbd-309e65ff6f1f tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:18.553862 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-57e7194d-3614-4364-a807-69ea328f6aed tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:18.555217 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-57e7194d-3614-4364-a807-69ea328f6aed tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:18.563507 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-57e7194d-3614-4364-a807-69ea328f6aed tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:18.564423 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-57e7194d-3614-4364-a807-69ea328f6aed tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:18.565049 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-57e7194d-3614-4364-a807-69ea328f6aed tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:18.566013 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-57e7194d-3614-4364-a807-69ea328f6aed tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:18.566624 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-57e7194d-3614-4364-a807-69ea328f6aed tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:18.567300 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-57e7194d-3614-4364-a807-69ea328f6aed tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:18.623204 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bb29939c-3187-4694-abbd-309e65ff6f1f tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:18.631421 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bb29939c-3187-4694-abbd-309e65ff6f1f tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1214 microversion: 2.1 time: 0.130033 Aug 08 14:32:18.632334 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 95/186] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:18 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:18.816469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-57e7194d-3614-4364-a807-69ea328f6aed tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:18.833801 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-57e7194d-3614-4364-a807-69ea328f6aed tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1314 microversion: 2.1 time: 0.286526 Aug 08 14:32:18.835661 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 92/187] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:18 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:19.653231 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-25c6dbfd-7e82-4770-a6bf-68f1644d4704 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:19.653845 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-25c6dbfd-7e82-4770-a6bf-68f1644d4704 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:19.660190 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25c6dbfd-7e82-4770-a6bf-68f1644d4704 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:19.660675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25c6dbfd-7e82-4770-a6bf-68f1644d4704 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:19.661112 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25c6dbfd-7e82-4770-a6bf-68f1644d4704 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:19.661811 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25c6dbfd-7e82-4770-a6bf-68f1644d4704 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:19.662265 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25c6dbfd-7e82-4770-a6bf-68f1644d4704 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:19.662690 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25c6dbfd-7e82-4770-a6bf-68f1644d4704 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:19.744610 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-25c6dbfd-7e82-4770-a6bf-68f1644d4704 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:19.753636 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-25c6dbfd-7e82-4770-a6bf-68f1644d4704 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1210 microversion: 2.1 time: 0.104056 Aug 08 14:32:19.768091 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 96/188] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:19 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1210 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:19.872731 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d4d62c3f-daa4-48e3-9393-449705773c03 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:19.873617 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d4d62c3f-daa4-48e3-9393-449705773c03 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:19.895930 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4d62c3f-daa4-48e3-9393-449705773c03 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:19.896426 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4d62c3f-daa4-48e3-9393-449705773c03 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:19.896865 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4d62c3f-daa4-48e3-9393-449705773c03 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:19.898688 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4d62c3f-daa4-48e3-9393-449705773c03 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:19.899186 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4d62c3f-daa4-48e3-9393-449705773c03 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:19.899620 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4d62c3f-daa4-48e3-9393-449705773c03 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:20.255859 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d4d62c3f-daa4-48e3-9393-449705773c03 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:20.270137 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d4d62c3f-daa4-48e3-9393-449705773c03 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1498 microversion: 2.1 time: 0.416939 Aug 08 14:32:20.272449 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 93/189] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:19 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1498 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:20.780181 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-385b5439-012c-442e-aa77-02c5ed6dc570 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:20.782004 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-385b5439-012c-442e-aa77-02c5ed6dc570 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:20.792110 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-385b5439-012c-442e-aa77-02c5ed6dc570 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:20.792745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-385b5439-012c-442e-aa77-02c5ed6dc570 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:20.794089 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-385b5439-012c-442e-aa77-02c5ed6dc570 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:20.794925 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-385b5439-012c-442e-aa77-02c5ed6dc570 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:20.795503 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-385b5439-012c-442e-aa77-02c5ed6dc570 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:20.796546 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-385b5439-012c-442e-aa77-02c5ed6dc570 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:20.879716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-385b5439-012c-442e-aa77-02c5ed6dc570 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:20.892337 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-385b5439-012c-442e-aa77-02c5ed6dc570 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1266 microversion: 2.1 time: 0.117877 Aug 08 14:32:20.892960 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 97/190] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:20 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:21.913756 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0735b8ba-4515-480f-bf54-4c14e2e1ead1 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:21.914826 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-0735b8ba-4515-480f-bf54-4c14e2e1ead1 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:21.925173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0735b8ba-4515-480f-bf54-4c14e2e1ead1 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:21.925711 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0735b8ba-4515-480f-bf54-4c14e2e1ead1 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:21.926161 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0735b8ba-4515-480f-bf54-4c14e2e1ead1 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:21.926900 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0735b8ba-4515-480f-bf54-4c14e2e1ead1 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:21.927426 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0735b8ba-4515-480f-bf54-4c14e2e1ead1 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:21.927856 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0735b8ba-4515-480f-bf54-4c14e2e1ead1 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:21.993535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-0735b8ba-4515-480f-bf54-4c14e2e1ead1 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:22.001240 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0735b8ba-4515-480f-bf54-4c14e2e1ead1 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1266 microversion: 2.1 time: 0.091501 Aug 08 14:32:22.001790 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 94/191] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:21 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:23.022022 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-26baa901-7700-4f80-8404-00b80f3f184e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:23.022686 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-26baa901-7700-4f80-8404-00b80f3f184e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:23.031625 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-26baa901-7700-4f80-8404-00b80f3f184e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:23.032118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-26baa901-7700-4f80-8404-00b80f3f184e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:23.032553 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-26baa901-7700-4f80-8404-00b80f3f184e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:23.033252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-26baa901-7700-4f80-8404-00b80f3f184e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:23.033714 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-26baa901-7700-4f80-8404-00b80f3f184e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:23.034122 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-26baa901-7700-4f80-8404-00b80f3f184e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:23.149571 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-26baa901-7700-4f80-8404-00b80f3f184e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:23.195918 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-26baa901-7700-4f80-8404-00b80f3f184e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1284 microversion: 2.1 time: 0.177849 Aug 08 14:32:23.196832 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 98/192] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:23 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:23.359816 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8977bc75-10cc-4d7b-b2de-1f094078962a tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:23.360942 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8977bc75-10cc-4d7b-b2de-1f094078962a tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:23.368212 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8977bc75-10cc-4d7b-b2de-1f094078962a tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:23.368921 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8977bc75-10cc-4d7b-b2de-1f094078962a tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:23.369506 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8977bc75-10cc-4d7b-b2de-1f094078962a tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:23.370355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8977bc75-10cc-4d7b-b2de-1f094078962a tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:23.370972 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8977bc75-10cc-4d7b-b2de-1f094078962a tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:23.371565 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8977bc75-10cc-4d7b-b2de-1f094078962a tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:23.427321 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8977bc75-10cc-4d7b-b2de-1f094078962a tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Going to try to terminate instance {{(pid=118062) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:32:23.588181 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8977bc75-10cc-4d7b-b2de-1f094078962a tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "DELETE /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 204 len: 0 microversion: 2.1 time: 0.231755 Aug 08 14:32:23.593845 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 95/193] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:32:23 2022] DELETE /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:32:23.600485 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-34bb04f5-8acb-42be-b63b-383517c0a61b tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:23.601393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-34bb04f5-8acb-42be-b63b-383517c0a61b tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:23.612372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-34bb04f5-8acb-42be-b63b-383517c0a61b tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:23.616344 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-34bb04f5-8acb-42be-b63b-383517c0a61b tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:23.618340 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-34bb04f5-8acb-42be-b63b-383517c0a61b tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:23.620610 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-34bb04f5-8acb-42be-b63b-383517c0a61b tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:23.622142 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-34bb04f5-8acb-42be-b63b-383517c0a61b tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:23.623522 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-34bb04f5-8acb-42be-b63b-383517c0a61b tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:24.052033 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-34bb04f5-8acb-42be-b63b-383517c0a61b tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:24.064671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-34bb04f5-8acb-42be-b63b-383517c0a61b tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1504 microversion: 2.1 time: 0.468767 Aug 08 14:32:24.066059 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 99/194] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:23 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1504 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:24.219563 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-339da592-c9a2-430c-bb91-9080a5d1f931 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:24.220436 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-339da592-c9a2-430c-bb91-9080a5d1f931 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:24.231368 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-339da592-c9a2-430c-bb91-9080a5d1f931 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:24.231867 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-339da592-c9a2-430c-bb91-9080a5d1f931 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:24.232305 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-339da592-c9a2-430c-bb91-9080a5d1f931 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:24.233015 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-339da592-c9a2-430c-bb91-9080a5d1f931 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:24.233470 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-339da592-c9a2-430c-bb91-9080a5d1f931 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:24.233893 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-339da592-c9a2-430c-bb91-9080a5d1f931 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:24.549395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-339da592-c9a2-430c-bb91-9080a5d1f931 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:24.559044 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-339da592-c9a2-430c-bb91-9080a5d1f931 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1314 microversion: 2.1 time: 0.343741 Aug 08 14:32:24.559662 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 96/195] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:24 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:25.087048 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b67c5815-71ce-4c90-b74a-711e184cbc3e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:25.087684 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b67c5815-71ce-4c90-b74a-711e184cbc3e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:25.094143 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b67c5815-71ce-4c90-b74a-711e184cbc3e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:25.094952 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b67c5815-71ce-4c90-b74a-711e184cbc3e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:25.095566 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b67c5815-71ce-4c90-b74a-711e184cbc3e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:25.096443 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b67c5815-71ce-4c90-b74a-711e184cbc3e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:25.097054 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b67c5815-71ce-4c90-b74a-711e184cbc3e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:25.097470 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b67c5815-71ce-4c90-b74a-711e184cbc3e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:25.580192 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8d0f7a60-2392-4e55-9d05-424dfc50b9ad tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:25.581717 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8d0f7a60-2392-4e55-9d05-424dfc50b9ad tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:25.598536 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8d0f7a60-2392-4e55-9d05-424dfc50b9ad tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:25.599401 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8d0f7a60-2392-4e55-9d05-424dfc50b9ad tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:25.599996 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8d0f7a60-2392-4e55-9d05-424dfc50b9ad tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:25.600884 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8d0f7a60-2392-4e55-9d05-424dfc50b9ad tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:25.601495 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8d0f7a60-2392-4e55-9d05-424dfc50b9ad tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:25.602596 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8d0f7a60-2392-4e55-9d05-424dfc50b9ad tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:25.643941 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:25.815141 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b67c5815-71ce-4c90-b74a-711e184cbc3e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:25.825163 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:25.829035 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b67c5815-71ce-4c90-b74a-711e184cbc3e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1504 microversion: 2.1 time: 0.745778 Aug 08 14:32:25.830143 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 100/196] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:25 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1504 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:26.102073 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8d0f7a60-2392-4e55-9d05-424dfc50b9ad tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:26.110153 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8d0f7a60-2392-4e55-9d05-424dfc50b9ad tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1314 microversion: 2.1 time: 0.533678 Aug 08 14:32:26.124597 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 97/197] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:25 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:26.520632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-15484127-537e-4bb4-acfc-89335aca808c req-0d2d330d-6485-4d35-9751-2b3be68066d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b0f93c3-489a-4b78-acd3-b78cfb85c99a", "tag": "cd800aff-5d03-445d-a114-1785a0d68286"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:26.551973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-15484127-537e-4bb4-acfc-89335aca808c req-0d2d330d-6485-4d35-9751-2b3be68066d4 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:26.552721 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-15484127-537e-4bb4-acfc-89335aca808c req-0d2d330d-6485-4d35-9751-2b3be68066d4 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:26.553357 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-15484127-537e-4bb4-acfc-89335aca808c req-0d2d330d-6485-4d35-9751-2b3be68066d4 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:26.594012 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-15484127-537e-4bb4-acfc-89335aca808c req-0d2d330d-6485-4d35-9751-2b3be68066d4 service nova] Creating event network-changed:cd800aff-5d03-445d-a114-1785a0d68286 for instance 2b0f93c3-489a-4b78-acd3-b78cfb85c99a on hv-cinder-85200 Aug 08 14:32:26.604514 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-15484127-537e-4bb4-acfc-89335aca808c req-0d2d330d-6485-4d35-9751-2b3be68066d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104808 Aug 08 14:32:26.606939 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 101/198] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:26.850679 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5280932a-c792-42c5-9f82-77951fba9f0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:26.851265 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5280932a-c792-42c5-9f82-77951fba9f0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:26.887837 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5280932a-c792-42c5-9f82-77951fba9f0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:26.889929 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5280932a-c792-42c5-9f82-77951fba9f0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:26.890388 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5280932a-c792-42c5-9f82-77951fba9f0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:26.891155 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5280932a-c792-42c5-9f82-77951fba9f0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:26.900231 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5280932a-c792-42c5-9f82-77951fba9f0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:26.901964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5280932a-c792-42c5-9f82-77951fba9f0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:26.978178 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5280932a-c792-42c5-9f82-77951fba9f0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:26.978874 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5280932a-c792-42c5-9f82-77951fba9f0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:26.979653 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5280932a-c792-42c5-9f82-77951fba9f0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:26.980570 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-5280932a-c792-42c5-9f82-77951fba9f0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lazy-loading 'fault' on Instance uuid 96b8d431-87ce-4ca7-93c3-e636c05fdf63 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:32:27.055620 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5280932a-c792-42c5-9f82-77951fba9f0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:27.064328 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5280932a-c792-42c5-9f82-77951fba9f0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 200 len: 1304 microversion: 2.1 time: 0.218227 Aug 08 14:32:27.065185 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 98/199] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:26 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 1304 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:27.132663 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-77814978-09b1-4b22-8fa6-80ea4ecec510 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:27.133720 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-77814978-09b1-4b22-8fa6-80ea4ecec510 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:27.140800 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-77814978-09b1-4b22-8fa6-80ea4ecec510 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:27.141441 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-77814978-09b1-4b22-8fa6-80ea4ecec510 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:27.142314 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-77814978-09b1-4b22-8fa6-80ea4ecec510 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:27.143322 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-77814978-09b1-4b22-8fa6-80ea4ecec510 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:27.143923 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-77814978-09b1-4b22-8fa6-80ea4ecec510 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:27.144444 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-77814978-09b1-4b22-8fa6-80ea4ecec510 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:27.380392 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-77814978-09b1-4b22-8fa6-80ea4ecec510 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:27.393628 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-77814978-09b1-4b22-8fa6-80ea4ecec510 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1314 microversion: 2.1 time: 0.266134 Aug 08 14:32:27.397159 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 102/200] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:27 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:28.086487 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e01c04bb-0999-4a22-a2de-5d5f5a0d22a0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:28.087122 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e01c04bb-0999-4a22-a2de-5d5f5a0d22a0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 96b8d431-87ce-4ca7-93c3-e636c05fdf63] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:28.093521 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e01c04bb-0999-4a22-a2de-5d5f5a0d22a0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:28.093998 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e01c04bb-0999-4a22-a2de-5d5f5a0d22a0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:28.094614 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e01c04bb-0999-4a22-a2de-5d5f5a0d22a0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:28.095415 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e01c04bb-0999-4a22-a2de-5d5f5a0d22a0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:28.095519 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1556241883", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:28.095950 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e01c04bb-0999-4a22-a2de-5d5f5a0d22a0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:28.096351 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e01c04bb-0999-4a22-a2de-5d5f5a0d22a0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:28.131050 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-e01c04bb-0999-4a22-a2de-5d5f5a0d22a0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] HTTP exception thrown: Instance 96b8d431-87ce-4ca7-93c3-e636c05fdf63 could not be found. Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e01c04bb-0999-4a22-a2de-5d5f5a0d22a0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Request method failure captured: Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 HTTP/1.1 Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R5g1AS42mxzt5LLSsTuiqp7ekuI7lbllLbALdsmTMCA5xLgdFfBZSuY9glZAMndcxEMEVAbBl7VZZNEEtaG92qtNv1c_ylQSVwXzWe8NK8tTx1E5iKnHpC1HxhMCvaqcUngK_IwQTOhi7TL3mliwOPJ6kXTOx6zm45p2f_itkX4nGQ Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: d6dae806b3c14f3fa1d2a491214de9f8 Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesActionsTest-790176281 Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:32:28.132776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:32:28.134184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d6dae806b3c14f3fa1d2a491214de9f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d6dae806b3c14f3fa1d2a491214de9f8", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6dae806b3c14f3fa1d2a491214de9f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6dae806b3c14f3fa1d2a491214de9f8"}]}] Aug 08 14:32:28.134184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesActionsTest-790176281 Aug 08 14:32:28.134184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: d6dae806b3c14f3fa1d2a491214de9f8 Aug 08 14:32:28.134184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesActionsTest-790176281 Aug 08 14:32:28.134184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesActionsTest-790176281-project Aug 08 14:32:28.134184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:32:28.134184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:32:28.134184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: c29b21ee2cd341169a2c8263393c5db6 Aug 08 14:32:28.134184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesActionsTest-790176281-project Aug 08 14:32:28.134184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:32:28.134184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance 96b8d431-87ce-4ca7-93c3-e636c05fdf63 could not be found. Aug 08 14:32:28.134184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '96b8d431-87ce-4ca7-93c3-e636c05fdf63'} Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96b8d431-87ce-4ca7-93c3-e636c05fdf63 could not be found. Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:32:28.134886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96b8d431-87ce-4ca7-93c3-e636c05fdf63 could not be found. Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96b8d431-87ce-4ca7-93c3-e636c05fdf63 could not be found. Aug 08 14:32:28.136407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:32:28.137441 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e01c04bb-0999-4a22-a2de-5d5f5a0d22a0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Returning 404 to user: Instance 96b8d431-87ce-4ca7-93c3-e636c05fdf63 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:32:28.144366 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e01c04bb-0999-4a22-a2de-5d5f5a0d22a0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63" status: 404 len: 111 microversion: 2.1 time: 0.060894 Aug 08 14:32:28.146308 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 103/201] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:28 2022] GET /compute/v2.1/servers/96b8d431-87ce-4ca7-93c3-e636c05fdf63 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 14:32:28.164941 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.network.neutron [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] validate_networks() for [('b5965902-5636-46a2-859e-f08b04b16ee2', None, None, None, None, None)] {{(pid=118062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:32:28.330914 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-957662500", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "networks": [{"uuid": "d21c9477-68f6-4e32-8832-8c0d67e51ed7"}]}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:28.420018 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:28.426523 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=6 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:28.438012 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] validate_networks() for [('d21c9477-68f6-4e32-8832-8c0d67e51ed7', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:32:28.630524 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:29.116171 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Flavor limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:32:29.116592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Image limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:32:29.117010 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Flavor pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:32:29.117999 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Image pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:32:29.118408 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:32:29.127235 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:29.127710 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:29.128422 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:29.129141 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:29.129669 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:29.130050 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:29.153091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Getting quotas for project 6ecb83fbcae94dca82331ab87f028878. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:32:29.157623 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Getting quotas for user 7d373dfa8c474ade92e94dc73dd9926f and project 6ecb83fbcae94dca82331ab87f028878. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:32:29.173524 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Going to run 1 instances... {{(pid=118062) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:32:29.177609 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:32:29.236676 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e7edd6c0-6961-472c-849a-24c7e8c744de tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.277004 Aug 08 14:32:29.238192 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 99/202] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:32:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:32:29.243261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4468a269-0d90-4f07-8063-8f2729f24800 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:29.244405 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-4468a269-0d90-4f07-8063-8f2729f24800 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:29.251715 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4468a269-0d90-4f07-8063-8f2729f24800 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:29.252534 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4468a269-0d90-4f07-8063-8f2729f24800 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:29.253200 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4468a269-0d90-4f07-8063-8f2729f24800 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:29.254107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4468a269-0d90-4f07-8063-8f2729f24800 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:29.254761 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4468a269-0d90-4f07-8063-8f2729f24800 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:29.255640 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4468a269-0d90-4f07-8063-8f2729f24800 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:29.345365 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:32:29.345833 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:32:29.346318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:32:29.346784 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:32:29.347371 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:32:29.363293 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:29.364094 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:29.365021 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:29.366825 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:29.368237 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:29.368929 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:29.395698 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Getting quotas for project d6dae806b3c14f3fa1d2a491214de9f8. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:32:29.407650 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Getting quotas for user c29b21ee2cd341169a2c8263393c5db6 and project d6dae806b3c14f3fa1d2a491214de9f8. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:32:29.430685 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:32:29.433875 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:32:29.507989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b64ac2b2-5e19-47b1-bbe1-45f3e963f211 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.182455 Aug 08 14:32:29.518490 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 104/203] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:32:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 14:32:29.527636 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-c5e52d92-eb13-46a5-b68e-a842c4b0736a req-71bc2727-c4c5-465a-b3c6-4afcfbd36999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b8d431-87ce-4ca7-93c3-e636c05fdf63", "name": "network-vif-deleted", "tag": "15fff200-264e-4d97-9216-236356507e2a"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:29.547172 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-c5e52d92-eb13-46a5-b68e-a842c4b0736a req-71bc2727-c4c5-465a-b3c6-4afcfbd36999 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:29.547871 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-c5e52d92-eb13-46a5-b68e-a842c4b0736a req-71bc2727-c4c5-465a-b3c6-4afcfbd36999 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:29.548412 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-c5e52d92-eb13-46a5-b68e-a842c4b0736a req-71bc2727-c4c5-465a-b3c6-4afcfbd36999 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:29.563534 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-c5e52d92-eb13-46a5-b68e-a842c4b0736a req-71bc2727-c4c5-465a-b3c6-4afcfbd36999 service nova] Creating event network-vif-deleted:15fff200-264e-4d97-9216-236356507e2a for instance 96b8d431-87ce-4ca7-93c3-e636c05fdf63 on hv-cinder-85200 Aug 08 14:32:29.569976 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-c5e52d92-eb13-46a5-b68e-a842c4b0736a req-71bc2727-c4c5-465a-b3c6-4afcfbd36999 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050127 Aug 08 14:32:29.571026 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 105/204] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:29.577207 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ccfca8bf-8180-493c-9617-0206cbd7c408 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:29.578185 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ccfca8bf-8180-493c-9617-0206cbd7c408 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:29.674481 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ccfca8bf-8180-493c-9617-0206cbd7c408 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:29.682850 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ccfca8bf-8180-493c-9617-0206cbd7c408 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1222 microversion: 2.1 time: 0.110175 Aug 08 14:32:29.684739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 106/205] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:29 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:29.684933 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4468a269-0d90-4f07-8063-8f2729f24800 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:29.692630 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7c125370-70d0-448d-8171-aa27cc3adb51 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:29.693929 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7c125370-70d0-448d-8171-aa27cc3adb51 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:29.699368 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-4468a269-0d90-4f07-8063-8f2729f24800 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1314 microversion: 2.1 time: 0.459757 Aug 08 14:32:29.699958 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 100/206] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:29 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:29.783938 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7c125370-70d0-448d-8171-aa27cc3adb51 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:29.793368 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7c125370-70d0-448d-8171-aa27cc3adb51 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1213 microversion: 2.1 time: 0.107123 Aug 08 14:32:29.795584 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 107/207] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:29 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:29.818232 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2068165939", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:29.924865 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.network.neutron [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] validate_networks() for [('b5965902-5636-46a2-859e-f08b04b16ee2', None, None, None, None, None)] {{(pid=118062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:32:29.996547 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1849586156", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1484870203", "security_groups": [{"name": "tempest-secgroup-smoke-95557263"}], "block_device_mapping_v2": [{"uuid": "0ba07900-fda3-4fbf-9bf5-b29bb61aa83b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7a23184-1226-4562-af07-174dc1a651ae"}]}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:30.234459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] validate_networks() for [('f7a23184-1226-4562-af07-174dc1a651ae', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:32:31.142754 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Flavor limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:32:31.143444 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Image limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:32:31.144877 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Flavor pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:32:31.145587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Image pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:32:31.145984 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:32:31.176010 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:31.176751 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:31.177597 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:31.178636 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:31.180920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:31.182489 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:31.212364 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Getting quotas for project 6ecb83fbcae94dca82331ab87f028878. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:32:31.215898 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:31.218797 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Getting quotas for user 7d373dfa8c474ade92e94dc73dd9926f and project 6ecb83fbcae94dca82331ab87f028878. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:32:31.235395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Going to run 1 instances... {{(pid=118062) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:32:31.238726 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:32:31.312753 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ab11a0d8-d0c6-4a3c-9807-c3889e1779a5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.499156 Aug 08 14:32:31.315577 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 101/208] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:32:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:32:31.328804 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-52e6be70-e71d-4ef5-aec7-e2ae3cbc4276 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:31.329428 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-52e6be70-e71d-4ef5-aec7-e2ae3cbc4276 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:31.338125 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-52e6be70-e71d-4ef5-aec7-e2ae3cbc4276 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:31.338621 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-52e6be70-e71d-4ef5-aec7-e2ae3cbc4276 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:31.339135 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-52e6be70-e71d-4ef5-aec7-e2ae3cbc4276 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:31.340576 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-52e6be70-e71d-4ef5-aec7-e2ae3cbc4276 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:31.341222 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-52e6be70-e71d-4ef5-aec7-e2ae3cbc4276 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:31.341797 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-52e6be70-e71d-4ef5-aec7-e2ae3cbc4276 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:31.495337 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:32:31.495820 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:32:31.496996 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:32:31.503474 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:32:31.504167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:32:31.533297 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:31.546369 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:31.548149 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:31.548704 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:31.549629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:31.550257 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:31.550806 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:31.579235 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Getting quotas for project 8aac3d3b720c45e8817bda1fe4d2d157. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:32:31.585081 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Getting quotas for user 2495d3c63dc44049872afb908ca6133b and project 8aac3d3b720c45e8817bda1fe4d2d157. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:32:31.655609 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:32:31.658196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ba07900-fda3-4fbf-9bf5-b29bb61aa83b',volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:32:31.744474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-52e6be70-e71d-4ef5-aec7-e2ae3cbc4276 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:31.755490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-52e6be70-e71d-4ef5-aec7-e2ae3cbc4276 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1314 microversion: 2.1 time: 0.430784 Aug 08 14:32:31.767408 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 102/209] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:31 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:31.770438 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-28a30a37-c415-4d65-9d2b-33f4bd3c2aa2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:31.773341 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-28a30a37-c415-4d65-9d2b-33f4bd3c2aa2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:31.789467 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-28a30a37-c415-4d65-9d2b-33f4bd3c2aa2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:31.792063 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-28a30a37-c415-4d65-9d2b-33f4bd3c2aa2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:31.792576 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-28a30a37-c415-4d65-9d2b-33f4bd3c2aa2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:31.795747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-28a30a37-c415-4d65-9d2b-33f4bd3c2aa2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:31.797315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-28a30a37-c415-4d65-9d2b-33f4bd3c2aa2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:31.798752 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-28a30a37-c415-4d65-9d2b-33f4bd3c2aa2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:31.891656 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b7fda361-3d84-49a0-b5e7-896ec2bef6d9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.900924 Aug 08 14:32:31.897159 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 108/210] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:32:29 2022] POST /compute/v2.1/servers => generated 404 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:32:31.905919 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8368f41c-ce95-4abd-98f4-27f805585a61 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:31.909711 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8368f41c-ce95-4abd-98f4-27f805585a61 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:31.924547 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8368f41c-ce95-4abd-98f4-27f805585a61 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:31.927484 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8368f41c-ce95-4abd-98f4-27f805585a61 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:31.928132 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8368f41c-ce95-4abd-98f4-27f805585a61 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:31.929568 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8368f41c-ce95-4abd-98f4-27f805585a61 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:31.932145 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8368f41c-ce95-4abd-98f4-27f805585a61 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:31.960897 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8368f41c-ce95-4abd-98f4-27f805585a61 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:31.961883 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-28a30a37-c415-4d65-9d2b-33f4bd3c2aa2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:31.997323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-28a30a37-c415-4d65-9d2b-33f4bd3c2aa2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1271 microversion: 2.1 time: 0.240174 Aug 08 14:32:31.999953 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 103/211] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:31 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:32.010255 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-334c5eac-0fd0-4287-a54e-8b3043c9bd77 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:32.011817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-334c5eac-0fd0-4287-a54e-8b3043c9bd77 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:32.146209 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8368f41c-ce95-4abd-98f4-27f805585a61 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:32.154841 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-334c5eac-0fd0-4287-a54e-8b3043c9bd77 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:32.172639 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-334c5eac-0fd0-4287-a54e-8b3043c9bd77 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1095 microversion: 2.1 time: 0.171506 Aug 08 14:32:32.173480 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8368f41c-ce95-4abd-98f4-27f805585a61 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1226 microversion: 2.1 time: 0.273105 Aug 08 14:32:32.174408 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 109/212] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:31 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1226 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:32.175373 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 104/213] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:31 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1095 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:32.401277 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-64b58fe7-56ec-404d-8084-b9260992921a req-5cb8fc49-0932-404b-8cfa-e36446c53bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0f93c3-489a-4b78-acd3-b78cfb85c99a", "name": "network-vif-plugged", "status": "completed", "tag": "cd800aff-5d03-445d-a114-1785a0d68286"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:32.428186 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-64b58fe7-56ec-404d-8084-b9260992921a req-5cb8fc49-0932-404b-8cfa-e36446c53bcd service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:32.429066 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-64b58fe7-56ec-404d-8084-b9260992921a req-5cb8fc49-0932-404b-8cfa-e36446c53bcd service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:32.431338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-64b58fe7-56ec-404d-8084-b9260992921a req-5cb8fc49-0932-404b-8cfa-e36446c53bcd service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:32.450814 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-64b58fe7-56ec-404d-8084-b9260992921a req-5cb8fc49-0932-404b-8cfa-e36446c53bcd service nova] Creating event network-vif-plugged:cd800aff-5d03-445d-a114-1785a0d68286 for instance 2b0f93c3-489a-4b78-acd3-b78cfb85c99a on hv-cinder-85200 Aug 08 14:32:32.457841 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-64b58fe7-56ec-404d-8084-b9260992921a req-5cb8fc49-0932-404b-8cfa-e36446c53bcd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062462 Aug 08 14:32:32.458587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 105/214] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:32.786396 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-22bd31fa-56b6-4149-9402-49031d7e5867 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:32.788338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-22bd31fa-56b6-4149-9402-49031d7e5867 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:32.800720 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-22bd31fa-56b6-4149-9402-49031d7e5867 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:32.805241 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-22bd31fa-56b6-4149-9402-49031d7e5867 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:32.808183 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-22bd31fa-56b6-4149-9402-49031d7e5867 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:32.810233 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-22bd31fa-56b6-4149-9402-49031d7e5867 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:32.812448 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-22bd31fa-56b6-4149-9402-49031d7e5867 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:32.817441 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-22bd31fa-56b6-4149-9402-49031d7e5867 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:33.032067 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ad58e37b-c4d3-4616-8809-ca30dbbc98b0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:33.032794 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ad58e37b-c4d3-4616-8809-ca30dbbc98b0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:33.048615 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ad58e37b-c4d3-4616-8809-ca30dbbc98b0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:33.049460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ad58e37b-c4d3-4616-8809-ca30dbbc98b0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:33.050064 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ad58e37b-c4d3-4616-8809-ca30dbbc98b0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:33.050973 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ad58e37b-c4d3-4616-8809-ca30dbbc98b0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:33.052712 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ad58e37b-c4d3-4616-8809-ca30dbbc98b0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:33.055926 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ad58e37b-c4d3-4616-8809-ca30dbbc98b0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:33.137555 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-22bd31fa-56b6-4149-9402-49031d7e5867 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:33.147428 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-22bd31fa-56b6-4149-9402-49031d7e5867 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1314 microversion: 2.1 time: 0.371584 Aug 08 14:32:33.147950 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 110/215] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:32 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:33.186454 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ad58e37b-c4d3-4616-8809-ca30dbbc98b0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:33.195889 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ad58e37b-c4d3-4616-8809-ca30dbbc98b0 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1271 microversion: 2.1 time: 0.174318 Aug 08 14:32:33.196293 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5b672566-1caa-457e-b72d-ef157180f7d5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:33.196799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 106/216] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:33 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:33.197003 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5b672566-1caa-457e-b72d-ef157180f7d5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:33.203359 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b672566-1caa-457e-b72d-ef157180f7d5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:33.204066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b672566-1caa-457e-b72d-ef157180f7d5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:33.204514 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b672566-1caa-457e-b72d-ef157180f7d5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:33.205389 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b672566-1caa-457e-b72d-ef157180f7d5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:33.205848 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b672566-1caa-457e-b72d-ef157180f7d5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:33.206275 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b672566-1caa-457e-b72d-ef157180f7d5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:33.221205 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d32144f2-5d2a-4de0-9ef3-f27fbbbc86f7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:33.222145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d32144f2-5d2a-4de0-9ef3-f27fbbbc86f7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:33.229996 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d32144f2-5d2a-4de0-9ef3-f27fbbbc86f7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:33.230697 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d32144f2-5d2a-4de0-9ef3-f27fbbbc86f7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:33.231968 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d32144f2-5d2a-4de0-9ef3-f27fbbbc86f7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:33.232821 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d32144f2-5d2a-4de0-9ef3-f27fbbbc86f7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:33.233595 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d32144f2-5d2a-4de0-9ef3-f27fbbbc86f7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:33.234170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d32144f2-5d2a-4de0-9ef3-f27fbbbc86f7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:33.306610 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5b672566-1caa-457e-b72d-ef157180f7d5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:33.316606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5b672566-1caa-457e-b72d-ef157180f7d5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1280 microversion: 2.1 time: 0.125311 Aug 08 14:32:33.318135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 111/217] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:33 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1280 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:33.402678 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d32144f2-5d2a-4de0-9ef3-f27fbbbc86f7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:33.418016 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d32144f2-5d2a-4de0-9ef3-f27fbbbc86f7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1193 microversion: 2.1 time: 0.200954 Aug 08 14:32:33.419286 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 107/218] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:33 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1193 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:34.169328 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-23713181-02b7-41b1-a0ba-39463039941f tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:34.170555 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-23713181-02b7-41b1-a0ba-39463039941f tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:34.178531 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23713181-02b7-41b1-a0ba-39463039941f tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:34.181456 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23713181-02b7-41b1-a0ba-39463039941f tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:34.182082 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23713181-02b7-41b1-a0ba-39463039941f tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:34.183353 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23713181-02b7-41b1-a0ba-39463039941f tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:34.185522 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23713181-02b7-41b1-a0ba-39463039941f tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:34.185929 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23713181-02b7-41b1-a0ba-39463039941f tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:34.220065 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-43ea7ccc-9f65-429e-8b43-a4e5faaf3f90 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:34.221854 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-43ea7ccc-9f65-429e-8b43-a4e5faaf3f90 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:34.240705 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-43ea7ccc-9f65-429e-8b43-a4e5faaf3f90 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:34.242779 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-43ea7ccc-9f65-429e-8b43-a4e5faaf3f90 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:34.243466 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-43ea7ccc-9f65-429e-8b43-a4e5faaf3f90 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:34.246437 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-43ea7ccc-9f65-429e-8b43-a4e5faaf3f90 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:34.249236 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-43ea7ccc-9f65-429e-8b43-a4e5faaf3f90 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:34.250081 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-43ea7ccc-9f65-429e-8b43-a4e5faaf3f90 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:34.693254 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-23713181-02b7-41b1-a0ba-39463039941f tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:34.702107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-23713181-02b7-41b1-a0ba-39463039941f tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1314 microversion: 2.1 time: 0.537700 Aug 08 14:32:34.706873 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-43ea7ccc-9f65-429e-8b43-a4e5faaf3f90 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:34.715854 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 112/219] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:34 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:34.722120 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-43ea7ccc-9f65-429e-8b43-a4e5faaf3f90 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1313 microversion: 2.1 time: 0.508059 Aug 08 14:32:34.722781 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 108/220] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:34 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:34.729616 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-fa90ba8f-ee47-4a30-a969-7c56eed7245e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:34.729854 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-03217fc7-c71e-4403-9e8b-73ec5f5f9744 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:34.730477 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-03217fc7-c71e-4403-9e8b-73ec5f5f9744 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:34.731546 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-fa90ba8f-ee47-4a30-a969-7c56eed7245e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:34.741273 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fa90ba8f-ee47-4a30-a969-7c56eed7245e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:34.743581 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fa90ba8f-ee47-4a30-a969-7c56eed7245e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:34.744380 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fa90ba8f-ee47-4a30-a969-7c56eed7245e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:34.745392 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fa90ba8f-ee47-4a30-a969-7c56eed7245e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:34.745755 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03217fc7-c71e-4403-9e8b-73ec5f5f9744 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:34.746256 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03217fc7-c71e-4403-9e8b-73ec5f5f9744 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:34.746494 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fa90ba8f-ee47-4a30-a969-7c56eed7245e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:34.747161 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fa90ba8f-ee47-4a30-a969-7c56eed7245e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:34.750721 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03217fc7-c71e-4403-9e8b-73ec5f5f9744 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:34.751770 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03217fc7-c71e-4403-9e8b-73ec5f5f9744 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:34.754199 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03217fc7-c71e-4403-9e8b-73ec5f5f9744 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:34.755662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03217fc7-c71e-4403-9e8b-73ec5f5f9744 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:35.169300 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-fa90ba8f-ee47-4a30-a969-7c56eed7245e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:35.186224 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-fa90ba8f-ee47-4a30-a969-7c56eed7245e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1211 microversion: 2.1 time: 0.462018 Aug 08 14:32:35.187132 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 109/221] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:34 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1211 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:35.193748 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-7da14f1e-702e-4255-9d11-29a791ac4b24 req-e7565a47-d3b7-454e-89dd-75664bcd0db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34e27d5-eb90-4a3c-8d9c-64a0404431d4", "tag": "c9810bc7-4497-4380-9d9b-44cf29ea15c5"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:35.204348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-7da14f1e-702e-4255-9d11-29a791ac4b24 req-e7565a47-d3b7-454e-89dd-75664bcd0db1 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:35.204817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-7da14f1e-702e-4255-9d11-29a791ac4b24 req-e7565a47-d3b7-454e-89dd-75664bcd0db1 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:35.205238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-7da14f1e-702e-4255-9d11-29a791ac4b24 req-e7565a47-d3b7-454e-89dd-75664bcd0db1 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:35.216911 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-7da14f1e-702e-4255-9d11-29a791ac4b24 req-e7565a47-d3b7-454e-89dd-75664bcd0db1 service nova] Creating event network-changed:c9810bc7-4497-4380-9d9b-44cf29ea15c5 for instance e34e27d5-eb90-4a3c-8d9c-64a0404431d4 on hv-cinder-85200 Aug 08 14:32:35.222037 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-7da14f1e-702e-4255-9d11-29a791ac4b24 req-e7565a47-d3b7-454e-89dd-75664bcd0db1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033641 Aug 08 14:32:35.222728 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 110/222] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:35.332068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-03217fc7-c71e-4403-9e8b-73ec5f5f9744 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:35.344138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-03217fc7-c71e-4403-9e8b-73ec5f5f9744 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1322 microversion: 2.1 time: 0.625991 Aug 08 14:32:35.345131 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 113/223] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:34 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1322 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:35.724561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9e54f2b8-2bed-4d5d-b84d-279386aee686 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:35.725737 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9e54f2b8-2bed-4d5d-b84d-279386aee686 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:35.737253 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e54f2b8-2bed-4d5d-b84d-279386aee686 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:35.738229 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e54f2b8-2bed-4d5d-b84d-279386aee686 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:35.739000 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e54f2b8-2bed-4d5d-b84d-279386aee686 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:35.740353 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e54f2b8-2bed-4d5d-b84d-279386aee686 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:35.741580 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e54f2b8-2bed-4d5d-b84d-279386aee686 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:35.742225 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e54f2b8-2bed-4d5d-b84d-279386aee686 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:35.743768 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-98c0aebb-2b7a-4078-8834-428cbd0e6af1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:35.745225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-98c0aebb-2b7a-4078-8834-428cbd0e6af1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:35.754762 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98c0aebb-2b7a-4078-8834-428cbd0e6af1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:35.755566 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98c0aebb-2b7a-4078-8834-428cbd0e6af1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:35.756061 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98c0aebb-2b7a-4078-8834-428cbd0e6af1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:35.756776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98c0aebb-2b7a-4078-8834-428cbd0e6af1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:35.757286 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98c0aebb-2b7a-4078-8834-428cbd0e6af1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:35.757937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98c0aebb-2b7a-4078-8834-428cbd0e6af1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:36.155528 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-98c0aebb-2b7a-4078-8834-428cbd0e6af1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:36.163404 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-98c0aebb-2b7a-4078-8834-428cbd0e6af1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1313 microversion: 2.1 time: 0.424700 Aug 08 14:32:36.177099 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9e54f2b8-2bed-4d5d-b84d-279386aee686 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:36.177848 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 114/224] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:35 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:36.183446 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-4de45600-36f3-4a81-97ff-f845cc31f252 req-6fe7f156-2331-4a22-911e-7b3b143d5ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f83a0c-1b6f-446f-96d5-804d508e2cf9", "tag": "d2377ba9-ace6-4a33-8019-7093cab3996e"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:36.189331 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9e54f2b8-2bed-4d5d-b84d-279386aee686 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1464 microversion: 2.1 time: 0.469359 Aug 08 14:32:36.190921 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 111/225] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:35 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1464 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:36.199948 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-4de45600-36f3-4a81-97ff-f845cc31f252 req-6fe7f156-2331-4a22-911e-7b3b143d5ea1 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:36.200458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-4de45600-36f3-4a81-97ff-f845cc31f252 req-6fe7f156-2331-4a22-911e-7b3b143d5ea1 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:36.200883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-4de45600-36f3-4a81-97ff-f845cc31f252 req-6fe7f156-2331-4a22-911e-7b3b143d5ea1 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:36.223399 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-885fc55e-ef8b-4236-a6cf-09c72a9f2482 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:36.224028 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-885fc55e-ef8b-4236-a6cf-09c72a9f2482 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:36.231418 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-885fc55e-ef8b-4236-a6cf-09c72a9f2482 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:36.231917 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-885fc55e-ef8b-4236-a6cf-09c72a9f2482 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:36.232435 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-885fc55e-ef8b-4236-a6cf-09c72a9f2482 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:36.233175 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-885fc55e-ef8b-4236-a6cf-09c72a9f2482 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:36.233635 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-885fc55e-ef8b-4236-a6cf-09c72a9f2482 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:36.234062 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-885fc55e-ef8b-4236-a6cf-09c72a9f2482 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:36.235898 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-4de45600-36f3-4a81-97ff-f845cc31f252 req-6fe7f156-2331-4a22-911e-7b3b143d5ea1 service nova] Creating event network-changed:d2377ba9-ace6-4a33-8019-7093cab3996e for instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 on hv-cinder-85200 Aug 08 14:32:36.249165 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-4de45600-36f3-4a81-97ff-f845cc31f252 req-6fe7f156-2331-4a22-911e-7b3b143d5ea1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067378 Aug 08 14:32:36.249969 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 115/226] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:36.259515 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b04dab9d-e58e-49d8-a8d0-d9a7f71b54ba tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:36.260096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b04dab9d-e58e-49d8-a8d0-d9a7f71b54ba tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:36.266328 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b04dab9d-e58e-49d8-a8d0-d9a7f71b54ba tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:36.266813 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b04dab9d-e58e-49d8-a8d0-d9a7f71b54ba tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:36.267329 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b04dab9d-e58e-49d8-a8d0-d9a7f71b54ba tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:36.268012 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b04dab9d-e58e-49d8-a8d0-d9a7f71b54ba tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:36.268607 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b04dab9d-e58e-49d8-a8d0-d9a7f71b54ba tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:36.269192 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b04dab9d-e58e-49d8-a8d0-d9a7f71b54ba tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:36.295787 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b04dab9d-e58e-49d8-a8d0-d9a7f71b54ba tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:32:36.405927 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b04dab9d-e58e-49d8-a8d0-d9a7f71b54ba tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 204 len: 0 microversion: 2.1 time: 0.150830 Aug 08 14:32:36.406593 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 116/227] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:32:36 2022] DELETE /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:32:36.411931 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e8e5d759-4734-4c19-93ca-5121dee3fddf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:36.412628 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e8e5d759-4734-4c19-93ca-5121dee3fddf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:36.418735 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8e5d759-4734-4c19-93ca-5121dee3fddf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:36.419251 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8e5d759-4734-4c19-93ca-5121dee3fddf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:36.419693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8e5d759-4734-4c19-93ca-5121dee3fddf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:36.420386 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8e5d759-4734-4c19-93ca-5121dee3fddf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:36.420841 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8e5d759-4734-4c19-93ca-5121dee3fddf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:36.421308 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8e5d759-4734-4c19-93ca-5121dee3fddf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:36.427937 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-885fc55e-ef8b-4236-a6cf-09c72a9f2482 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:36.437236 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-885fc55e-ef8b-4236-a6cf-09c72a9f2482 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.220485 Aug 08 14:32:36.437815 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 112/228] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:36 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:36.458238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4fd1b3d0-4d1e-4f86-a62e-d0942b3512fc tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:36.458865 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-4fd1b3d0-4d1e-4f86-a62e-d0942b3512fc tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:36.465401 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4fd1b3d0-4d1e-4f86-a62e-d0942b3512fc tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:36.465887 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4fd1b3d0-4d1e-4f86-a62e-d0942b3512fc tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:36.466541 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4fd1b3d0-4d1e-4f86-a62e-d0942b3512fc tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:36.467280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4fd1b3d0-4d1e-4f86-a62e-d0942b3512fc tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:36.470291 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4fd1b3d0-4d1e-4f86-a62e-d0942b3512fc tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:36.470732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4fd1b3d0-4d1e-4f86-a62e-d0942b3512fc tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:36.612956 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e8e5d759-4734-4c19-93ca-5121dee3fddf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:36.620848 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e8e5d759-4734-4c19-93ca-5121dee3fddf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1322 microversion: 2.1 time: 0.213008 Aug 08 14:32:36.621693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 117/229] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:36 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:36.642900 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4fd1b3d0-4d1e-4f86-a62e-d0942b3512fc tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:36.650790 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-4fd1b3d0-4d1e-4f86-a62e-d0942b3512fc tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1470 microversion: 2.1 time: 0.208865 Aug 08 14:32:36.651390 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 113/230] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:36 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1470 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:37.184895 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4c14cbb4-a4b0-423d-87cf-926b04a2b4b2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:37.185672 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4c14cbb4-a4b0-423d-87cf-926b04a2b4b2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:37.191708 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c14cbb4-a4b0-423d-87cf-926b04a2b4b2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:37.192184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c14cbb4-a4b0-423d-87cf-926b04a2b4b2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:37.192615 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c14cbb4-a4b0-423d-87cf-926b04a2b4b2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:37.193295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c14cbb4-a4b0-423d-87cf-926b04a2b4b2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:37.193896 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c14cbb4-a4b0-423d-87cf-926b04a2b4b2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:37.194185 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c14cbb4-a4b0-423d-87cf-926b04a2b4b2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:37.326691 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4c14cbb4-a4b0-423d-87cf-926b04a2b4b2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:37.334514 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4c14cbb4-a4b0-423d-87cf-926b04a2b4b2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1313 microversion: 2.1 time: 0.153571 Aug 08 14:32:37.335232 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 118/231] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:37 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:37.457962 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-78e8e918-a2f0-4b65-8e44-929f2776aec9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:37.458574 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-78e8e918-a2f0-4b65-8e44-929f2776aec9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:37.466140 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-78e8e918-a2f0-4b65-8e44-929f2776aec9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:37.466635 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-78e8e918-a2f0-4b65-8e44-929f2776aec9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:37.467076 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-78e8e918-a2f0-4b65-8e44-929f2776aec9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:37.467806 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-78e8e918-a2f0-4b65-8e44-929f2776aec9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:37.468265 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-78e8e918-a2f0-4b65-8e44-929f2776aec9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:37.468695 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-78e8e918-a2f0-4b65-8e44-929f2776aec9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:37.613454 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-78e8e918-a2f0-4b65-8e44-929f2776aec9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:37.621624 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-78e8e918-a2f0-4b65-8e44-929f2776aec9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.167622 Aug 08 14:32:37.623289 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 114/232] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:37 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:37.641767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d4e1e6a8-dc38-480e-8f89-6d7fd268b361 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:37.642348 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d4e1e6a8-dc38-480e-8f89-6d7fd268b361 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:37.648305 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4e1e6a8-dc38-480e-8f89-6d7fd268b361 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:37.649320 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4e1e6a8-dc38-480e-8f89-6d7fd268b361 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:37.649760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4e1e6a8-dc38-480e-8f89-6d7fd268b361 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:37.650435 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4e1e6a8-dc38-480e-8f89-6d7fd268b361 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:37.650883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4e1e6a8-dc38-480e-8f89-6d7fd268b361 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:37.651349 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4e1e6a8-dc38-480e-8f89-6d7fd268b361 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:37.672066 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c6806816-257a-4152-bda1-2a4fbb587fcd tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:37.672978 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c6806816-257a-4152-bda1-2a4fbb587fcd tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:37.682087 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6806816-257a-4152-bda1-2a4fbb587fcd tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:37.682798 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6806816-257a-4152-bda1-2a4fbb587fcd tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:37.683285 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6806816-257a-4152-bda1-2a4fbb587fcd tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:37.684873 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6806816-257a-4152-bda1-2a4fbb587fcd tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:37.687203 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6806816-257a-4152-bda1-2a4fbb587fcd tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:37.688332 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6806816-257a-4152-bda1-2a4fbb587fcd tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:37.871392 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d4e1e6a8-dc38-480e-8f89-6d7fd268b361 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:37.880386 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d4e1e6a8-dc38-480e-8f89-6d7fd268b361 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1322 microversion: 2.1 time: 0.242438 Aug 08 14:32:37.880696 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c6806816-257a-4152-bda1-2a4fbb587fcd tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:37.881280 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 119/233] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:37 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:37.886060 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-f2435df2-f504-4b5d-b0eb-38767fc81f49 req-62547ace-8bd8-4d7f-83ab-20f48be16e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4173a09-ab1b-40aa-818f-5954b2c1bc6a", "tag": "23846c7c-43aa-487c-8739-8c59a0c6af7f"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:37.889016 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c6806816-257a-4152-bda1-2a4fbb587fcd tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1470 microversion: 2.1 time: 0.222053 Aug 08 14:32:37.890121 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 115/234] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:37 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1470 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:37.895219 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-f2435df2-f504-4b5d-b0eb-38767fc81f49 req-62547ace-8bd8-4d7f-83ab-20f48be16e35 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:37.895691 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-f2435df2-f504-4b5d-b0eb-38767fc81f49 req-62547ace-8bd8-4d7f-83ab-20f48be16e35 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:37.896115 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-f2435df2-f504-4b5d-b0eb-38767fc81f49 req-62547ace-8bd8-4d7f-83ab-20f48be16e35 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:37.906870 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-f2435df2-f504-4b5d-b0eb-38767fc81f49 req-62547ace-8bd8-4d7f-83ab-20f48be16e35 service nova] Creating event network-changed:23846c7c-43aa-487c-8739-8c59a0c6af7f for instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a on hv-cinder-85200 Aug 08 14:32:37.911641 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-f2435df2-f504-4b5d-b0eb-38767fc81f49 req-62547ace-8bd8-4d7f-83ab-20f48be16e35 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029103 Aug 08 14:32:37.912160 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 120/235] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:38.267373 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-0a2fe64f-50ad-4fd2-8c36-29ae406df620 req-739991ba-140c-4ac2-921e-a77e950518ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0945eb52-f2d0-45fd-8217-6f251794bad8", "tag": "2c011f55-7b8b-4997-a391-bc215a6aa450"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:38.277147 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-0a2fe64f-50ad-4fd2-8c36-29ae406df620 req-739991ba-140c-4ac2-921e-a77e950518ef service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:38.277626 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-0a2fe64f-50ad-4fd2-8c36-29ae406df620 req-739991ba-140c-4ac2-921e-a77e950518ef service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:38.278060 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-0a2fe64f-50ad-4fd2-8c36-29ae406df620 req-739991ba-140c-4ac2-921e-a77e950518ef service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:38.290190 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-0a2fe64f-50ad-4fd2-8c36-29ae406df620 req-739991ba-140c-4ac2-921e-a77e950518ef service nova] Creating event network-changed:2c011f55-7b8b-4997-a391-bc215a6aa450 for instance 0945eb52-f2d0-45fd-8217-6f251794bad8 on hv-cinder-85200 Aug 08 14:32:38.296380 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-0a2fe64f-50ad-4fd2-8c36-29ae406df620 req-739991ba-140c-4ac2-921e-a77e950518ef service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032450 Aug 08 14:32:38.297024 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 116/236] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:38.356101 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c7fa618e-7110-43e3-b9e4-222bc29e88f1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:38.356796 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c7fa618e-7110-43e3-b9e4-222bc29e88f1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:38.362993 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7fa618e-7110-43e3-b9e4-222bc29e88f1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:38.363506 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7fa618e-7110-43e3-b9e4-222bc29e88f1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:38.363942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7fa618e-7110-43e3-b9e4-222bc29e88f1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:38.364633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7fa618e-7110-43e3-b9e4-222bc29e88f1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:38.365082 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7fa618e-7110-43e3-b9e4-222bc29e88f1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:38.365503 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7fa618e-7110-43e3-b9e4-222bc29e88f1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:38.559662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c7fa618e-7110-43e3-b9e4-222bc29e88f1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:38.573196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c7fa618e-7110-43e3-b9e4-222bc29e88f1 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1313 microversion: 2.1 time: 0.221033 Aug 08 14:32:38.575972 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 121/237] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:38 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:38.643841 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c1e21356-805e-4be8-9b3c-7947109936f9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:38.645139 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c1e21356-805e-4be8-9b3c-7947109936f9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:38.652306 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c1e21356-805e-4be8-9b3c-7947109936f9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:38.652786 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c1e21356-805e-4be8-9b3c-7947109936f9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:38.653216 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c1e21356-805e-4be8-9b3c-7947109936f9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:38.653973 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c1e21356-805e-4be8-9b3c-7947109936f9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:38.654498 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c1e21356-805e-4be8-9b3c-7947109936f9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:38.654923 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c1e21356-805e-4be8-9b3c-7947109936f9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:38.900770 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b0588a00-9373-4000-b4d7-68b67ef645cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:38.901378 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b0588a00-9373-4000-b4d7-68b67ef645cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:38.911111 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b0588a00-9373-4000-b4d7-68b67ef645cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:38.911902 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b0588a00-9373-4000-b4d7-68b67ef645cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:38.912468 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b0588a00-9373-4000-b4d7-68b67ef645cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:38.913160 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b0588a00-9373-4000-b4d7-68b67ef645cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:38.913712 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b0588a00-9373-4000-b4d7-68b67ef645cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:38.914817 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b0588a00-9373-4000-b4d7-68b67ef645cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:38.936118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:39.183721 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c1e21356-805e-4be8-9b3c-7947109936f9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:39.191589 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c1e21356-805e-4be8-9b3c-7947109936f9 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.552341 Aug 08 14:32:39.204148 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 117/238] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:38 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:39.204148 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b3aa4558-c626-4ad4-8273-82c96979fa7e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:39.204148 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b3aa4558-c626-4ad4-8273-82c96979fa7e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:39.205235 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b3aa4558-c626-4ad4-8273-82c96979fa7e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:39.205914 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b3aa4558-c626-4ad4-8273-82c96979fa7e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:39.206507 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b3aa4558-c626-4ad4-8273-82c96979fa7e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:39.207433 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b3aa4558-c626-4ad4-8273-82c96979fa7e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:39.208161 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b3aa4558-c626-4ad4-8273-82c96979fa7e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:39.208740 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b3aa4558-c626-4ad4-8273-82c96979fa7e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:39.214413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=100 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:39.394919 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b0588a00-9373-4000-b4d7-68b67ef645cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:39.404548 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b0588a00-9373-4000-b4d7-68b67ef645cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1322 microversion: 2.1 time: 0.508130 Aug 08 14:32:39.405800 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 122/239] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:38 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:39.599425 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-51e6365e-79d3-4203-8b9f-1e862a098808 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:39.600031 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-51e6365e-79d3-4203-8b9f-1e862a098808 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:39.606381 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51e6365e-79d3-4203-8b9f-1e862a098808 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:39.606971 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51e6365e-79d3-4203-8b9f-1e862a098808 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:39.614427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51e6365e-79d3-4203-8b9f-1e862a098808 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:39.614427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51e6365e-79d3-4203-8b9f-1e862a098808 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:39.614427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51e6365e-79d3-4203-8b9f-1e862a098808 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:39.614427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51e6365e-79d3-4203-8b9f-1e862a098808 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:39.640645 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b3aa4558-c626-4ad4-8273-82c96979fa7e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:39.652370 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b3aa4558-c626-4ad4-8273-82c96979fa7e tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1470 microversion: 2.1 time: 0.458778 Aug 08 14:32:39.666227 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 118/240] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:39 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1470 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:40.161268 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-51e6365e-79d3-4203-8b9f-1e862a098808 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:40.181330 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-51e6365e-79d3-4203-8b9f-1e862a098808 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1313 microversion: 2.1 time: 0.586951 Aug 08 14:32:40.183074 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 123/241] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:39 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1313 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:40.218615 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-64001fdb-0693-4cea-8aab-d7bc2426a4f2 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:40.219367 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-64001fdb-0693-4cea-8aab-d7bc2426a4f2 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:40.230821 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-64001fdb-0693-4cea-8aab-d7bc2426a4f2 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:40.231363 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-64001fdb-0693-4cea-8aab-d7bc2426a4f2 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:40.231811 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-64001fdb-0693-4cea-8aab-d7bc2426a4f2 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:40.232564 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-64001fdb-0693-4cea-8aab-d7bc2426a4f2 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:40.233027 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-64001fdb-0693-4cea-8aab-d7bc2426a4f2 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:40.233478 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-64001fdb-0693-4cea-8aab-d7bc2426a4f2 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:40.261441 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-c0e7f644-99bf-4977-b930-a689b05b00ac req-89c458f7-6f2f-45e3-90ef-14af2b5d70a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34e27d5-eb90-4a3c-8d9c-64a0404431d4", "name": "network-vif-plugged", "status": "completed", "tag": "c9810bc7-4497-4380-9d9b-44cf29ea15c5"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:40.275684 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-c0e7f644-99bf-4977-b930-a689b05b00ac req-89c458f7-6f2f-45e3-90ef-14af2b5d70a2 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:40.276286 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-c0e7f644-99bf-4977-b930-a689b05b00ac req-89c458f7-6f2f-45e3-90ef-14af2b5d70a2 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:40.276860 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-c0e7f644-99bf-4977-b930-a689b05b00ac req-89c458f7-6f2f-45e3-90ef-14af2b5d70a2 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:40.290787 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-c0e7f644-99bf-4977-b930-a689b05b00ac req-89c458f7-6f2f-45e3-90ef-14af2b5d70a2 service nova] Creating event network-vif-plugged:c9810bc7-4497-4380-9d9b-44cf29ea15c5 for instance e34e27d5-eb90-4a3c-8d9c-64a0404431d4 on hv-cinder-85200 Aug 08 14:32:40.296537 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-c0e7f644-99bf-4977-b930-a689b05b00ac req-89c458f7-6f2f-45e3-90ef-14af2b5d70a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039395 Aug 08 14:32:40.297626 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 124/242] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:40.303991 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-7b033aae-d5d1-4fe2-80c6-2d5b02fd99f0 req-962c151d-d7b3-4a21-a932-68299c89660f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0f93c3-489a-4b78-acd3-b78cfb85c99a", "name": "network-vif-deleted", "tag": "cd800aff-5d03-445d-a114-1785a0d68286"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:40.319480 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-7b033aae-d5d1-4fe2-80c6-2d5b02fd99f0 req-962c151d-d7b3-4a21-a932-68299c89660f service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:40.319991 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-7b033aae-d5d1-4fe2-80c6-2d5b02fd99f0 req-962c151d-d7b3-4a21-a932-68299c89660f service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:40.320429 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-7b033aae-d5d1-4fe2-80c6-2d5b02fd99f0 req-962c151d-d7b3-4a21-a932-68299c89660f service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:40.336215 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-7b033aae-d5d1-4fe2-80c6-2d5b02fd99f0 req-962c151d-d7b3-4a21-a932-68299c89660f service nova] Creating event network-vif-deleted:cd800aff-5d03-445d-a114-1785a0d68286 for instance 2b0f93c3-489a-4b78-acd3-b78cfb85c99a on hv-cinder-85200 Aug 08 14:32:40.341354 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-7b033aae-d5d1-4fe2-80c6-2d5b02fd99f0 req-962c151d-d7b3-4a21-a932-68299c89660f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042140 Aug 08 14:32:40.344913 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 125/243] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:40.410250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-64001fdb-0693-4cea-8aab-d7bc2426a4f2 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:40.418963 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-64001fdb-0693-4cea-8aab-d7bc2426a4f2 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.207673 Aug 08 14:32:40.419552 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 119/244] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:40 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:40.426512 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-95a504a1-fed5-40d4-9567-aa1b0ab9742f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:40.427230 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-95a504a1-fed5-40d4-9567-aa1b0ab9742f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:40.433515 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95a504a1-fed5-40d4-9567-aa1b0ab9742f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:40.434003 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95a504a1-fed5-40d4-9567-aa1b0ab9742f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:40.434436 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95a504a1-fed5-40d4-9567-aa1b0ab9742f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:40.435144 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95a504a1-fed5-40d4-9567-aa1b0ab9742f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:40.435597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95a504a1-fed5-40d4-9567-aa1b0ab9742f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:40.436018 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95a504a1-fed5-40d4-9567-aa1b0ab9742f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:40.571602 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-95a504a1-fed5-40d4-9567-aa1b0ab9742f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:40.578974 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-95a504a1-fed5-40d4-9567-aa1b0ab9742f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1322 microversion: 2.1 time: 0.156554 Aug 08 14:32:40.579585 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 126/245] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:40 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:40.673375 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0d018690-58a8-44e2-a5ac-7f021f908751 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:40.673893 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-0d018690-58a8-44e2-a5ac-7f021f908751 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:40.680864 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d018690-58a8-44e2-a5ac-7f021f908751 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:40.681344 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d018690-58a8-44e2-a5ac-7f021f908751 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:40.681791 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d018690-58a8-44e2-a5ac-7f021f908751 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:40.682465 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d018690-58a8-44e2-a5ac-7f021f908751 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:40.682921 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d018690-58a8-44e2-a5ac-7f021f908751 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:40.683372 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d018690-58a8-44e2-a5ac-7f021f908751 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:40.695447 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9c4b3f3f-d91f-4a4e-a418-9c1ea48d29b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:40.695942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9c4b3f3f-d91f-4a4e-a418-9c1ea48d29b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:40.701796 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c4b3f3f-d91f-4a4e-a418-9c1ea48d29b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:40.702277 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c4b3f3f-d91f-4a4e-a418-9c1ea48d29b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:40.702707 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c4b3f3f-d91f-4a4e-a418-9c1ea48d29b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:40.703428 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c4b3f3f-d91f-4a4e-a418-9c1ea48d29b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:40.703880 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c4b3f3f-d91f-4a4e-a418-9c1ea48d29b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:40.704304 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c4b3f3f-d91f-4a4e-a418-9c1ea48d29b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:40.727839 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9c4b3f3f-d91f-4a4e-a418-9c1ea48d29b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/ips" status: 200 len: 152 microversion: 2.20 time: 0.036749 Aug 08 14:32:40.728890 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 127/246] 10.222.0.50 () {60 vars in 1289 bytes} [Mon Aug 8 14:32:40 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:32:40.750291 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-0d018690-58a8-44e2-a5ac-7f021f908751 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2414021316e24ff887ce3472689b7d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6551ae647e5470e971bfa089afc10e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:40.757910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0d018690-58a8-44e2-a5ac-7f021f908751 tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 200 len: 1428 microversion: 2.1 time: 0.088498 Aug 08 14:32:40.758455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 120/247] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:40 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:41.202731 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8b34449e-ee22-4fff-aae6-bd9118ec4dd2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:41.203407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8b34449e-ee22-4fff-aae6-bd9118ec4dd2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:41.209642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8b34449e-ee22-4fff-aae6-bd9118ec4dd2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:41.211397 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8b34449e-ee22-4fff-aae6-bd9118ec4dd2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:41.212011 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8b34449e-ee22-4fff-aae6-bd9118ec4dd2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:41.212864 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8b34449e-ee22-4fff-aae6-bd9118ec4dd2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:41.213463 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8b34449e-ee22-4fff-aae6-bd9118ec4dd2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:41.214034 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8b34449e-ee22-4fff-aae6-bd9118ec4dd2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:41.396441 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8b34449e-ee22-4fff-aae6-bd9118ec4dd2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:41.404706 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8b34449e-ee22-4fff-aae6-bd9118ec4dd2 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1313 microversion: 2.1 time: 0.206565 Aug 08 14:32:41.405281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 128/248] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:41 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:41.439429 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d2b08f49-d3bf-42d9-b619-663fb412a7ee tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:41.440014 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d2b08f49-d3bf-42d9-b619-663fb412a7ee tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:41.443666 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=4 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:41.447188 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d2b08f49-d3bf-42d9-b619-663fb412a7ee tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:41.447679 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d2b08f49-d3bf-42d9-b619-663fb412a7ee tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:41.448308 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d2b08f49-d3bf-42d9-b619-663fb412a7ee tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:41.449198 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d2b08f49-d3bf-42d9-b619-663fb412a7ee tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:41.449820 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d2b08f49-d3bf-42d9-b619-663fb412a7ee tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:41.450237 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d2b08f49-d3bf-42d9-b619-663fb412a7ee tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:41.600113 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ddd4fd02-0895-4d5e-a9a9-0e0d6d738a6e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:41.600846 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ddd4fd02-0895-4d5e-a9a9-0e0d6d738a6e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:41.602924 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=4 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:41.603648 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=16 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:41.611430 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ddd4fd02-0895-4d5e-a9a9-0e0d6d738a6e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:41.611920 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ddd4fd02-0895-4d5e-a9a9-0e0d6d738a6e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:41.612357 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ddd4fd02-0895-4d5e-a9a9-0e0d6d738a6e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:41.613279 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ddd4fd02-0895-4d5e-a9a9-0e0d6d738a6e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:41.613730 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ddd4fd02-0895-4d5e-a9a9-0e0d6d738a6e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:41.614151 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ddd4fd02-0895-4d5e-a9a9-0e0d6d738a6e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:41.758256 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d2b08f49-d3bf-42d9-b619-663fb412a7ee tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:41.765777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d2b08f49-d3bf-42d9-b619-663fb412a7ee tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.330257 Aug 08 14:32:41.766453 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 121/249] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:41 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:41.785491 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a61dcbb1-07a3-4c04-9017-29d17605827c tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:41.786112 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-a61dcbb1-07a3-4c04-9017-29d17605827c tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] [instance: 2b0f93c3-489a-4b78-acd3-b78cfb85c99a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:41.792218 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a61dcbb1-07a3-4c04-9017-29d17605827c tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:41.792712 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a61dcbb1-07a3-4c04-9017-29d17605827c tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:41.793161 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a61dcbb1-07a3-4c04-9017-29d17605827c tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:41.794134 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a61dcbb1-07a3-4c04-9017-29d17605827c tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:41.794592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a61dcbb1-07a3-4c04-9017-29d17605827c tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:41.795023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a61dcbb1-07a3-4c04-9017-29d17605827c tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:41.801124 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ddd4fd02-0895-4d5e-a9a9-0e0d6d738a6e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:41.809048 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ddd4fd02-0895-4d5e-a9a9-0e0d6d738a6e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1322 microversion: 2.1 time: 0.213077 Aug 08 14:32:41.809705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 129/250] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:41 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:41.810350 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-a61dcbb1-07a3-4c04-9017-29d17605827c tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] HTTP exception thrown: Instance 2b0f93c3-489a-4b78-acd3-b78cfb85c99a could not be found. Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a61dcbb1-07a3-4c04-9017-29d17605827c tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Request method failure captured: Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a HTTP/1.1 Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R5wzcxXSKWuob1CEsnM60lsbVMzvmqugr9FT6ulZ5bMJxdAw_4IaVTcfZMhwXUAmOvXHESdLeoVQWmHMVObuifQf814G0RJyK2R37uMN40jfmAnXV0MRrTc9SE8VCw1GA2kLh7TGPQCZyvNZBj1Gz3dBURar5hffQdkPlLDTAGhi80 Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: e6551ae647e5470e971bfa089afc10e4 Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-VolumesNegativeTest-697198400 Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:32:41.812214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:32:41.813501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e6551ae647e5470e971bfa089afc10e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e6551ae647e5470e971bfa089afc10e4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6551ae647e5470e971bfa089afc10e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6551ae647e5470e971bfa089afc10e4"}]}] Aug 08 14:32:41.813501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-VolumesNegativeTest-697198400 Aug 08 14:32:41.813501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: e6551ae647e5470e971bfa089afc10e4 Aug 08 14:32:41.813501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-VolumesNegativeTest-697198400 Aug 08 14:32:41.813501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-VolumesNegativeTest-697198400-project Aug 08 14:32:41.813501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:32:41.813501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:32:41.813501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 2414021316e24ff887ce3472689b7d51 Aug 08 14:32:41.813501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-VolumesNegativeTest-697198400-project Aug 08 14:32:41.813501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:32:41.813501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance 2b0f93c3-489a-4b78-acd3-b78cfb85c99a could not be found. Aug 08 14:32:41.813501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': '2b0f93c3-489a-4b78-acd3-b78cfb85c99a'} Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0f93c3-489a-4b78-acd3-b78cfb85c99a could not be found. Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:32:41.814315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0f93c3-489a-4b78-acd3-b78cfb85c99a could not be found. Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0f93c3-489a-4b78-acd3-b78cfb85c99a could not be found. Aug 08 14:32:41.815473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:32:41.816526 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a61dcbb1-07a3-4c04-9017-29d17605827c tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] Returning 404 to user: Instance 2b0f93c3-489a-4b78-acd3-b78cfb85c99a could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:32:41.816526 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-a61dcbb1-07a3-4c04-9017-29d17605827c tempest-VolumesNegativeTest-697198400 tempest-VolumesNegativeTest-697198400-project] 10.222.0.50 "GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a" status: 404 len: 111 microversion: 2.1 time: 0.033507 Aug 08 14:32:41.816526 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 122/251] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:41 2022] GET /compute/v2.1/servers/2b0f93c3-489a-4b78-acd3-b78cfb85c99a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 14:32:42.425638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-133fb745-f24d-4bdc-8a47-32f08d0ba145 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:42.426252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-133fb745-f24d-4bdc-8a47-32f08d0ba145 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:42.432680 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-133fb745-f24d-4bdc-8a47-32f08d0ba145 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:42.433153 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-133fb745-f24d-4bdc-8a47-32f08d0ba145 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:42.433581 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-133fb745-f24d-4bdc-8a47-32f08d0ba145 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:42.434898 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-133fb745-f24d-4bdc-8a47-32f08d0ba145 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:42.435392 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-133fb745-f24d-4bdc-8a47-32f08d0ba145 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:42.436025 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-133fb745-f24d-4bdc-8a47-32f08d0ba145 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:42.574064 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-133fb745-f24d-4bdc-8a47-32f08d0ba145 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:42.581962 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-133fb745-f24d-4bdc-8a47-32f08d0ba145 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1313 microversion: 2.1 time: 0.160100 Aug 08 14:32:42.582705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 130/252] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:42 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:42.786485 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-450110f1-f54f-40f0-be41-d372fb5c5a6b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:42.787240 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-450110f1-f54f-40f0-be41-d372fb5c5a6b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:42.793945 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=14 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:42.796402 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-450110f1-f54f-40f0-be41-d372fb5c5a6b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:42.797288 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-450110f1-f54f-40f0-be41-d372fb5c5a6b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:42.798010 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-450110f1-f54f-40f0-be41-d372fb5c5a6b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:42.799569 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-450110f1-f54f-40f0-be41-d372fb5c5a6b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:42.800233 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-450110f1-f54f-40f0-be41-d372fb5c5a6b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:42.800993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-450110f1-f54f-40f0-be41-d372fb5c5a6b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:42.830725 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a7f84134-4126-4d00-8767-99a1de41b44c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:42.831833 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a7f84134-4126-4d00-8767-99a1de41b44c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:42.847483 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a7f84134-4126-4d00-8767-99a1de41b44c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:42.847988 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a7f84134-4126-4d00-8767-99a1de41b44c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:42.848407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a7f84134-4126-4d00-8767-99a1de41b44c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:42.849391 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a7f84134-4126-4d00-8767-99a1de41b44c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:42.849764 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a7f84134-4126-4d00-8767-99a1de41b44c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:42.850185 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a7f84134-4126-4d00-8767-99a1de41b44c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:43.016679 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-450110f1-f54f-40f0-be41-d372fb5c5a6b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:43.025569 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-450110f1-f54f-40f0-be41-d372fb5c5a6b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.243018 Aug 08 14:32:43.026265 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 123/253] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:42 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:43.045501 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a7f84134-4126-4d00-8767-99a1de41b44c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:43.053069 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a7f84134-4126-4d00-8767-99a1de41b44c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1322 microversion: 2.1 time: 0.227240 Aug 08 14:32:43.053724 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 131/254] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:42 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:43.603358 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-eb3d1416-ad46-4016-8a50-ccfcdc03340e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:43.604318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-eb3d1416-ad46-4016-8a50-ccfcdc03340e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:43.610644 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb3d1416-ad46-4016-8a50-ccfcdc03340e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:43.611643 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb3d1416-ad46-4016-8a50-ccfcdc03340e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:43.612246 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb3d1416-ad46-4016-8a50-ccfcdc03340e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:43.613099 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb3d1416-ad46-4016-8a50-ccfcdc03340e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:43.613710 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb3d1416-ad46-4016-8a50-ccfcdc03340e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:43.614454 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb3d1416-ad46-4016-8a50-ccfcdc03340e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:43.844428 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-eb3d1416-ad46-4016-8a50-ccfcdc03340e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:43.854076 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-eb3d1416-ad46-4016-8a50-ccfcdc03340e tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1313 microversion: 2.1 time: 0.255366 Aug 08 14:32:43.854752 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 124/255] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:43 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:44.046937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b8cba8e0-ede2-4ece-9c32-f0e43dea5679 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:44.048239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b8cba8e0-ede2-4ece-9c32-f0e43dea5679 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:44.055894 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b8cba8e0-ede2-4ece-9c32-f0e43dea5679 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:44.056378 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b8cba8e0-ede2-4ece-9c32-f0e43dea5679 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:44.056813 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b8cba8e0-ede2-4ece-9c32-f0e43dea5679 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:44.057505 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b8cba8e0-ede2-4ece-9c32-f0e43dea5679 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:44.057954 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b8cba8e0-ede2-4ece-9c32-f0e43dea5679 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:44.058372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b8cba8e0-ede2-4ece-9c32-f0e43dea5679 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:44.076367 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5ef7bbe3-8ccb-4a4d-8e2d-70f06980e9b2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:44.077422 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5ef7bbe3-8ccb-4a4d-8e2d-70f06980e9b2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:44.084016 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5ef7bbe3-8ccb-4a4d-8e2d-70f06980e9b2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:44.085328 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5ef7bbe3-8ccb-4a4d-8e2d-70f06980e9b2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:44.085876 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5ef7bbe3-8ccb-4a4d-8e2d-70f06980e9b2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:44.086822 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5ef7bbe3-8ccb-4a4d-8e2d-70f06980e9b2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:44.087576 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5ef7bbe3-8ccb-4a4d-8e2d-70f06980e9b2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:44.088276 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5ef7bbe3-8ccb-4a4d-8e2d-70f06980e9b2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:44.272589 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b8cba8e0-ede2-4ece-9c32-f0e43dea5679 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:44.280649 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b8cba8e0-ede2-4ece-9c32-f0e43dea5679 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.237742 Aug 08 14:32:44.281506 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 132/256] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:44 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:44.303614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5ef7bbe3-8ccb-4a4d-8e2d-70f06980e9b2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:44.312852 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5ef7bbe3-8ccb-4a4d-8e2d-70f06980e9b2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1517 microversion: 2.1 time: 0.242299 Aug 08 14:32:44.313365 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 125/257] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:44 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1517 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:44.335106 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-adbf82dd-8a8d-45ae-84db-c93d3756ac3b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:44.337509 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-adbf82dd-8a8d-45ae-84db-c93d3756ac3b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:44.343809 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-adbf82dd-8a8d-45ae-84db-c93d3756ac3b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:44.344291 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-adbf82dd-8a8d-45ae-84db-c93d3756ac3b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:44.344933 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-adbf82dd-8a8d-45ae-84db-c93d3756ac3b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:44.345629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-adbf82dd-8a8d-45ae-84db-c93d3756ac3b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:44.346561 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-adbf82dd-8a8d-45ae-84db-c93d3756ac3b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:44.346982 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-adbf82dd-8a8d-45ae-84db-c93d3756ac3b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:44.372128 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-adbf82dd-8a8d-45ae-84db-c93d3756ac3b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lazy-loading 'flavor' on Instance uuid e34e27d5-eb90-4a3c-8d9c-64a0404431d4 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:32:44.495811 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-adbf82dd-8a8d-45ae-84db-c93d3756ac3b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "POST /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4/action" status: 200 len: 32 microversion: 2.1 time: 0.164518 Aug 08 14:32:44.496705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 133/258] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 14:32:44 2022] POST /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 14:32:44.512155 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2df414bf-c4e7-49e4-9dcd-cc7ff8e40f3f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:44.512784 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2df414bf-c4e7-49e4-9dcd-cc7ff8e40f3f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:44.519196 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2df414bf-c4e7-49e4-9dcd-cc7ff8e40f3f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:44.519690 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2df414bf-c4e7-49e4-9dcd-cc7ff8e40f3f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:44.520115 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2df414bf-c4e7-49e4-9dcd-cc7ff8e40f3f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:44.520812 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2df414bf-c4e7-49e4-9dcd-cc7ff8e40f3f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:44.521955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2df414bf-c4e7-49e4-9dcd-cc7ff8e40f3f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:44.522562 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2df414bf-c4e7-49e4-9dcd-cc7ff8e40f3f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:44.568936 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-82a45cdf-e3d0-488f-bcf4-b689a2892076 req-c70d240f-06fc-4617-9d58-9d1cc5aca64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0945eb52-f2d0-45fd-8217-6f251794bad8", "name": "network-vif-plugged", "status": "completed", "tag": "2c011f55-7b8b-4997-a391-bc215a6aa450"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:44.582026 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-82a45cdf-e3d0-488f-bcf4-b689a2892076 req-c70d240f-06fc-4617-9d58-9d1cc5aca64e service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:44.582797 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-82a45cdf-e3d0-488f-bcf4-b689a2892076 req-c70d240f-06fc-4617-9d58-9d1cc5aca64e service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:44.583235 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-82a45cdf-e3d0-488f-bcf4-b689a2892076 req-c70d240f-06fc-4617-9d58-9d1cc5aca64e service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:44.596231 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-82a45cdf-e3d0-488f-bcf4-b689a2892076 req-c70d240f-06fc-4617-9d58-9d1cc5aca64e service nova] Creating event network-vif-plugged:2c011f55-7b8b-4997-a391-bc215a6aa450 for instance 0945eb52-f2d0-45fd-8217-6f251794bad8 on hv-cinder-85200 Aug 08 14:32:44.602022 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-82a45cdf-e3d0-488f-bcf4-b689a2892076 req-c70d240f-06fc-4617-9d58-9d1cc5aca64e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036706 Aug 08 14:32:44.602751 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 134/259] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:44.707538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2df414bf-c4e7-49e4-9dcd-cc7ff8e40f3f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:44.718624 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2df414bf-c4e7-49e4-9dcd-cc7ff8e40f3f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.216650 Aug 08 14:32:44.719810 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 126/260] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:44 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:44.874852 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d585b533-34e8-4337-81e2-d3d62bbfcc0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:44.875903 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d585b533-34e8-4337-81e2-d3d62bbfcc0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:44.891176 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d585b533-34e8-4337-81e2-d3d62bbfcc0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:44.891691 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d585b533-34e8-4337-81e2-d3d62bbfcc0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:44.892119 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d585b533-34e8-4337-81e2-d3d62bbfcc0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:44.892809 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d585b533-34e8-4337-81e2-d3d62bbfcc0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:44.893255 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d585b533-34e8-4337-81e2-d3d62bbfcc0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:44.893674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d585b533-34e8-4337-81e2-d3d62bbfcc0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:45.166466 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d585b533-34e8-4337-81e2-d3d62bbfcc0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:45.174463 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d585b533-34e8-4337-81e2-d3d62bbfcc0c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1313 microversion: 2.1 time: 0.303973 Aug 08 14:32:45.175033 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 135/261] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:44 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:45.301421 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-625d7337-950c-4f9f-9731-06103219b840 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:45.302025 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-625d7337-950c-4f9f-9731-06103219b840 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:45.308515 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-625d7337-950c-4f9f-9731-06103219b840 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:45.308946 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-625d7337-950c-4f9f-9731-06103219b840 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:45.309379 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-625d7337-950c-4f9f-9731-06103219b840 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:45.310064 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-625d7337-950c-4f9f-9731-06103219b840 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:45.310548 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-625d7337-950c-4f9f-9731-06103219b840 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:45.310974 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-625d7337-950c-4f9f-9731-06103219b840 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:45.534313 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-625d7337-950c-4f9f-9731-06103219b840 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:45.542904 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-625d7337-950c-4f9f-9731-06103219b840 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.245289 Aug 08 14:32:45.544224 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 127/262] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:45 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:45.705471 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-689e138e-d38e-4bea-a6b1-e62e5dd6818d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:45.705997 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-689e138e-d38e-4bea-a6b1-e62e5dd6818d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:45.711927 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-689e138e-d38e-4bea-a6b1-e62e5dd6818d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:45.712402 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-689e138e-d38e-4bea-a6b1-e62e5dd6818d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:45.712835 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-689e138e-d38e-4bea-a6b1-e62e5dd6818d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:45.713526 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-689e138e-d38e-4bea-a6b1-e62e5dd6818d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:45.713977 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-689e138e-d38e-4bea-a6b1-e62e5dd6818d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:45.714399 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-689e138e-d38e-4bea-a6b1-e62e5dd6818d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:45.736194 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-689e138e-d38e-4bea-a6b1-e62e5dd6818d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lazy-loading 'flavor' on Instance uuid fd0245e7-b0d0-4fbe-a233-4b3e7768b94c {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:32:45.745042 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c76200c8-6f5e-4ad8-a611-b38163986894 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:45.745674 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c76200c8-6f5e-4ad8-a611-b38163986894 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:45.751606 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c76200c8-6f5e-4ad8-a611-b38163986894 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:45.752087 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c76200c8-6f5e-4ad8-a611-b38163986894 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:45.752574 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c76200c8-6f5e-4ad8-a611-b38163986894 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:45.753262 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c76200c8-6f5e-4ad8-a611-b38163986894 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:45.753712 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c76200c8-6f5e-4ad8-a611-b38163986894 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:45.754138 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c76200c8-6f5e-4ad8-a611-b38163986894 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:45.931721 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-689e138e-d38e-4bea-a6b1-e62e5dd6818d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "POST /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/action" status: 202 len: 0 microversion: 2.20 time: 0.230055 Aug 08 14:32:45.932319 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 136/263] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Aug 8 14:32:45 2022] POST /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 08 14:32:45.941594 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6db35fa8-cf95-462c-83f2-0fa7220c3932 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:45.942306 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6db35fa8-cf95-462c-83f2-0fa7220c3932 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:45.948745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6db35fa8-cf95-462c-83f2-0fa7220c3932 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:45.949234 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6db35fa8-cf95-462c-83f2-0fa7220c3932 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:45.949732 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6db35fa8-cf95-462c-83f2-0fa7220c3932 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:45.950957 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6db35fa8-cf95-462c-83f2-0fa7220c3932 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:45.951580 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6db35fa8-cf95-462c-83f2-0fa7220c3932 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:45.952064 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6db35fa8-cf95-462c-83f2-0fa7220c3932 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:45.972959 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:46.133499 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c76200c8-6f5e-4ad8-a611-b38163986894 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:46.145116 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c76200c8-6f5e-4ad8-a611-b38163986894 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.404224 Aug 08 14:32:46.151143 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 128/264] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:45 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:46.195224 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9677cee0-929c-4714-8644-f45e2db61a82 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:46.195843 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9677cee0-929c-4714-8644-f45e2db61a82 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:46.201652 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6db35fa8-cf95-462c-83f2-0fa7220c3932 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:46.204764 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9677cee0-929c-4714-8644-f45e2db61a82 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:46.206170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9677cee0-929c-4714-8644-f45e2db61a82 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:46.208523 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9677cee0-929c-4714-8644-f45e2db61a82 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:46.209313 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9677cee0-929c-4714-8644-f45e2db61a82 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:46.209711 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9677cee0-929c-4714-8644-f45e2db61a82 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:46.210144 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9677cee0-929c-4714-8644-f45e2db61a82 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:46.211342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6db35fa8-cf95-462c-83f2-0fa7220c3932 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:46.220354 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6db35fa8-cf95-462c-83f2-0fa7220c3932 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:46.222563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6db35fa8-cf95-462c-83f2-0fa7220c3932 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.285715 Aug 08 14:32:46.242692 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 137/265] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:32:45 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:32:46.407514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9677cee0-929c-4714-8644-f45e2db61a82 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:46.419482 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9677cee0-929c-4714-8644-f45e2db61a82 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1313 microversion: 2.1 time: 0.227752 Aug 08 14:32:46.420931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 129/266] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:46 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:46.564944 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1e09d5ad-2609-4fd4-83c6-c87ed100466a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:46.565656 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1e09d5ad-2609-4fd4-83c6-c87ed100466a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:46.572639 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1e09d5ad-2609-4fd4-83c6-c87ed100466a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:46.573212 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1e09d5ad-2609-4fd4-83c6-c87ed100466a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:46.573864 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1e09d5ad-2609-4fd4-83c6-c87ed100466a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:46.574833 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1e09d5ad-2609-4fd4-83c6-c87ed100466a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:46.575355 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1e09d5ad-2609-4fd4-83c6-c87ed100466a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:46.576050 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1e09d5ad-2609-4fd4-83c6-c87ed100466a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:46.651843 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-52b957af-7e01-4501-b1ad-7862fb3a750a req-a94d7d99-a3dc-45d4-9096-9fdd595bb3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f83a0c-1b6f-446f-96d5-804d508e2cf9", "name": "network-vif-plugged", "status": "completed", "tag": "d2377ba9-ace6-4a33-8019-7093cab3996e"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:46.664738 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-52b957af-7e01-4501-b1ad-7862fb3a750a req-a94d7d99-a3dc-45d4-9096-9fdd595bb3a7 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:46.665219 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-52b957af-7e01-4501-b1ad-7862fb3a750a req-a94d7d99-a3dc-45d4-9096-9fdd595bb3a7 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:46.665660 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-52b957af-7e01-4501-b1ad-7862fb3a750a req-a94d7d99-a3dc-45d4-9096-9fdd595bb3a7 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:46.679043 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-52b957af-7e01-4501-b1ad-7862fb3a750a req-a94d7d99-a3dc-45d4-9096-9fdd595bb3a7 service nova] Creating event network-vif-plugged:d2377ba9-ace6-4a33-8019-7093cab3996e for instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 on hv-cinder-85200 Aug 08 14:32:46.685038 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-52b957af-7e01-4501-b1ad-7862fb3a750a req-a94d7d99-a3dc-45d4-9096-9fdd595bb3a7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037632 Aug 08 14:32:46.688517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 130/267] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:32:46.752204 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1e09d5ad-2609-4fd4-83c6-c87ed100466a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:46.760700 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1e09d5ad-2609-4fd4-83c6-c87ed100466a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.199845 Aug 08 14:32:46.761287 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 138/268] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:46 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:46.969947 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a123b81c-5c6a-4ac7-a1ff-03cb734ead6f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:46.970557 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-a123b81c-5c6a-4ac7-a1ff-03cb734ead6f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:46.976779 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a123b81c-5c6a-4ac7-a1ff-03cb734ead6f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:46.977262 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a123b81c-5c6a-4ac7-a1ff-03cb734ead6f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:46.977779 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a123b81c-5c6a-4ac7-a1ff-03cb734ead6f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:46.978388 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a123b81c-5c6a-4ac7-a1ff-03cb734ead6f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:46.978968 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a123b81c-5c6a-4ac7-a1ff-03cb734ead6f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:46.979626 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a123b81c-5c6a-4ac7-a1ff-03cb734ead6f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:47.009728 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-a123b81c-5c6a-4ac7-a1ff-03cb734ead6f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/ips" status: 200 len: 148 microversion: 2.1 time: 0.044492 Aug 08 14:32:47.010290 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 131/269] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 14:32:46 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/ips => generated 148 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:47.169427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1fcde58c-d26d-4b10-b191-808d5f40dccf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:47.170258 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1fcde58c-d26d-4b10-b191-808d5f40dccf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:47.176695 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fcde58c-d26d-4b10-b191-808d5f40dccf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:47.177267 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fcde58c-d26d-4b10-b191-808d5f40dccf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:47.177823 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fcde58c-d26d-4b10-b191-808d5f40dccf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:47.178594 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fcde58c-d26d-4b10-b191-808d5f40dccf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:47.179810 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fcde58c-d26d-4b10-b191-808d5f40dccf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:47.180384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fcde58c-d26d-4b10-b191-808d5f40dccf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:47.265903 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-209733ad-4150-41fa-9f67-c95e6b668961 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:47.267053 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-209733ad-4150-41fa-9f67-c95e6b668961 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:47.274094 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-209733ad-4150-41fa-9f67-c95e6b668961 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:47.274883 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-209733ad-4150-41fa-9f67-c95e6b668961 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:47.275530 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-209733ad-4150-41fa-9f67-c95e6b668961 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:47.276413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-209733ad-4150-41fa-9f67-c95e6b668961 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:47.277047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-209733ad-4150-41fa-9f67-c95e6b668961 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:47.278156 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-209733ad-4150-41fa-9f67-c95e6b668961 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:47.451492 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1fcde58c-d26d-4b10-b191-808d5f40dccf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:47.462863 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1fcde58c-d26d-4b10-b191-808d5f40dccf tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.295936 Aug 08 14:32:47.463823 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 139/270] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:47 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:47.469954 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e8e9e95c-baf5-4f59-9be4-0921d2a7fe2c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:47.470831 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e8e9e95c-baf5-4f59-9be4-0921d2a7fe2c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:47.477481 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8e9e95c-baf5-4f59-9be4-0921d2a7fe2c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:47.478143 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8e9e95c-baf5-4f59-9be4-0921d2a7fe2c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:47.483230 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8e9e95c-baf5-4f59-9be4-0921d2a7fe2c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:47.484638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8e9e95c-baf5-4f59-9be4-0921d2a7fe2c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:47.485358 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8e9e95c-baf5-4f59-9be4-0921d2a7fe2c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:47.486239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8e9e95c-baf5-4f59-9be4-0921d2a7fe2c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:47.491315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-209733ad-4150-41fa-9f67-c95e6b668961 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:47.502066 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-209733ad-4150-41fa-9f67-c95e6b668961 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:47.504312 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-209733ad-4150-41fa-9f67-c95e6b668961 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:47.506687 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-209733ad-4150-41fa-9f67-c95e6b668961 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.244071 Aug 08 14:32:47.507491 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 132/271] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:32:47 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:32:47.631055 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e8e9e95c-baf5-4f59-9be4-0921d2a7fe2c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:47.641256 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e8e9e95c-baf5-4f59-9be4-0921d2a7fe2c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1497 microversion: 2.1 time: 0.176135 Aug 08 14:32:47.641968 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 140/272] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:47 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:47.783468 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2903503e-840e-497c-b9bd-7d7456a6b3ec tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:47.784465 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2903503e-840e-497c-b9bd-7d7456a6b3ec tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:47.791942 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2903503e-840e-497c-b9bd-7d7456a6b3ec tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:47.792731 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2903503e-840e-497c-b9bd-7d7456a6b3ec tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:47.794183 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2903503e-840e-497c-b9bd-7d7456a6b3ec tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:47.795078 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2903503e-840e-497c-b9bd-7d7456a6b3ec tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:47.795750 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2903503e-840e-497c-b9bd-7d7456a6b3ec tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:47.796591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2903503e-840e-497c-b9bd-7d7456a6b3ec tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:47.977553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2903503e-840e-497c-b9bd-7d7456a6b3ec tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:47.985272 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2903503e-840e-497c-b9bd-7d7456a6b3ec tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.205869 Aug 08 14:32:47.986017 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 133/273] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:47 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:48.106487 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0258c5a8-db8d-46be-a5cf-17aa0f6facbc tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:48.106972 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0258c5a8-db8d-46be-a5cf-17aa0f6facbc tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:48.112871 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0258c5a8-db8d-46be-a5cf-17aa0f6facbc tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:48.113350 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0258c5a8-db8d-46be-a5cf-17aa0f6facbc tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:48.113785 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0258c5a8-db8d-46be-a5cf-17aa0f6facbc tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:48.114467 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0258c5a8-db8d-46be-a5cf-17aa0f6facbc tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:48.114919 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0258c5a8-db8d-46be-a5cf-17aa0f6facbc tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:48.115374 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0258c5a8-db8d-46be-a5cf-17aa0f6facbc tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:48.138094 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0258c5a8-db8d-46be-a5cf-17aa0f6facbc tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/ips" status: 200 len: 145 microversion: 2.1 time: 0.035527 Aug 08 14:32:48.138733 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 141/274] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 14:32:48 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:48.376500 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1b974302-5112-4545-ad79-0834819c0055 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:48.377057 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1b974302-5112-4545-ad79-0834819c0055 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:48.384150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1b974302-5112-4545-ad79-0834819c0055 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:48.384630 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1b974302-5112-4545-ad79-0834819c0055 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:48.385057 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1b974302-5112-4545-ad79-0834819c0055 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:48.385738 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1b974302-5112-4545-ad79-0834819c0055 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:48.386193 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1b974302-5112-4545-ad79-0834819c0055 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:48.386607 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1b974302-5112-4545-ad79-0834819c0055 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:48.412313 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1b974302-5112-4545-ad79-0834819c0055 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Going to try to terminate instance {{(pid=118062) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:32:48.467858 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:48.482304 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-221da94b-de1b-4d75-9ee9-fbea8634d4dd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb2e329d-3492-4c8d-96df-3172a85c5169"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:48.484736 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-221da94b-de1b-4d75-9ee9-fbea8634d4dd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:48.490587 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-221da94b-de1b-4d75-9ee9-fbea8634d4dd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:48.491136 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-221da94b-de1b-4d75-9ee9-fbea8634d4dd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:48.492108 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-221da94b-de1b-4d75-9ee9-fbea8634d4dd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:48.493052 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-221da94b-de1b-4d75-9ee9-fbea8634d4dd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:48.493870 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-221da94b-de1b-4d75-9ee9-fbea8634d4dd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:48.494496 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-221da94b-de1b-4d75-9ee9-fbea8634d4dd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:48.498870 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1b974302-5112-4545-ad79-0834819c0055 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 204 len: 0 microversion: 2.1 time: 0.125990 Aug 08 14:32:48.500075 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 134/275] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:32:48 2022] DELETE /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:32:48.505735 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f57982cd-ba77-438c-87fa-13ea7a1f0ef8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:48.506576 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f57982cd-ba77-438c-87fa-13ea7a1f0ef8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:48.514819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f57982cd-ba77-438c-87fa-13ea7a1f0ef8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:48.515559 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f57982cd-ba77-438c-87fa-13ea7a1f0ef8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:48.516198 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f57982cd-ba77-438c-87fa-13ea7a1f0ef8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:48.517610 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f57982cd-ba77-438c-87fa-13ea7a1f0ef8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:48.518075 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f57982cd-ba77-438c-87fa-13ea7a1f0ef8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:48.518504 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f57982cd-ba77-438c-87fa-13ea7a1f0ef8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:48.659145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f57982cd-ba77-438c-87fa-13ea7a1f0ef8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:48.666966 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f57982cd-ba77-438c-87fa-13ea7a1f0ef8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.165589 Aug 08 14:32:48.667501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 135/276] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:48 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:48.672150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-010b1619-ebd9-4e3f-8681-26344f990b10 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:48.672749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-010b1619-ebd9-4e3f-8681-26344f990b10 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:48.678429 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-010b1619-ebd9-4e3f-8681-26344f990b10 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:48.678910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-010b1619-ebd9-4e3f-8681-26344f990b10 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:48.679918 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-010b1619-ebd9-4e3f-8681-26344f990b10 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:48.680608 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-010b1619-ebd9-4e3f-8681-26344f990b10 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:48.681058 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-010b1619-ebd9-4e3f-8681-26344f990b10 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:48.681476 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-010b1619-ebd9-4e3f-8681-26344f990b10 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:48.811376 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-010b1619-ebd9-4e3f-8681-26344f990b10 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:48.818717 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-010b1619-ebd9-4e3f-8681-26344f990b10 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1503 microversion: 2.1 time: 0.150302 Aug 08 14:32:48.819303 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 136/277] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:48 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:48.829450 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a4331d5f-dd10-4b7c-abbd-8d0fe0b00512 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:48.829450 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-a4331d5f-dd10-4b7c-abbd-8d0fe0b00512 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:48.830319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a4331d5f-dd10-4b7c-abbd-8d0fe0b00512 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:48.830792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a4331d5f-dd10-4b7c-abbd-8d0fe0b00512 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:48.831264 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a4331d5f-dd10-4b7c-abbd-8d0fe0b00512 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:48.831946 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a4331d5f-dd10-4b7c-abbd-8d0fe0b00512 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:48.832390 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a4331d5f-dd10-4b7c-abbd-8d0fe0b00512 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:48.832817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a4331d5f-dd10-4b7c-abbd-8d0fe0b00512 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:48.964590 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-a4331d5f-dd10-4b7c-abbd-8d0fe0b00512 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:48.972635 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-a4331d5f-dd10-4b7c-abbd-8d0fe0b00512 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:48.974158 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-a4331d5f-dd10-4b7c-abbd-8d0fe0b00512 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:48.975337 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-a4331d5f-dd10-4b7c-abbd-8d0fe0b00512 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.155060 Aug 08 14:32:48.975907 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 137/278] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:32:48 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:32:49.006380 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b4c46034-222c-4293-a9d5-a93ec22b41ef tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:49.007367 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b4c46034-222c-4293-a9d5-a93ec22b41ef tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:49.014473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b4c46034-222c-4293-a9d5-a93ec22b41ef tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:49.015121 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b4c46034-222c-4293-a9d5-a93ec22b41ef tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:49.015754 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b4c46034-222c-4293-a9d5-a93ec22b41ef tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:49.016576 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b4c46034-222c-4293-a9d5-a93ec22b41ef tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:49.017098 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b4c46034-222c-4293-a9d5-a93ec22b41ef tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:49.017585 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b4c46034-222c-4293-a9d5-a93ec22b41ef tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:49.182350 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b4c46034-222c-4293-a9d5-a93ec22b41ef tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:49.189774 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b4c46034-222c-4293-a9d5-a93ec22b41ef tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.187773 Aug 08 14:32:49.190389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 138/279] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:49 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:49.688547 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8ae5f9bd-0079-406f-85cd-6eda302030b0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:49.689174 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8ae5f9bd-0079-406f-85cd-6eda302030b0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:49.695871 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ae5f9bd-0079-406f-85cd-6eda302030b0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:49.696359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ae5f9bd-0079-406f-85cd-6eda302030b0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:49.696795 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ae5f9bd-0079-406f-85cd-6eda302030b0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:49.697487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ae5f9bd-0079-406f-85cd-6eda302030b0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:49.697982 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ae5f9bd-0079-406f-85cd-6eda302030b0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:49.698365 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ae5f9bd-0079-406f-85cd-6eda302030b0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:49.853781 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8ae5f9bd-0079-406f-85cd-6eda302030b0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:49.864885 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8ae5f9bd-0079-406f-85cd-6eda302030b0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.179646 Aug 08 14:32:49.865441 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 139/280] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:49 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:49.874344 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-22977cac-36be-4c52-8227-0290e13c11fa tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:49.875210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-22977cac-36be-4c52-8227-0290e13c11fa tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:49.882045 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22977cac-36be-4c52-8227-0290e13c11fa tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:49.882540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22977cac-36be-4c52-8227-0290e13c11fa tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:49.882971 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22977cac-36be-4c52-8227-0290e13c11fa tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:49.883713 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22977cac-36be-4c52-8227-0290e13c11fa tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:49.884167 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22977cac-36be-4c52-8227-0290e13c11fa tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:49.884589 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22977cac-36be-4c52-8227-0290e13c11fa tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:50.011717 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-22977cac-36be-4c52-8227-0290e13c11fa tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:50.019225 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-22977cac-36be-4c52-8227-0290e13c11fa tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1503 microversion: 2.1 time: 0.152234 Aug 08 14:32:50.019789 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 140/281] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:49 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:50.025630 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7eb1c336-5640-409e-aed0-adcf0497b289 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:50.026318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7eb1c336-5640-409e-aed0-adcf0497b289 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:50.032077 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7eb1c336-5640-409e-aed0-adcf0497b289 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:50.032636 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7eb1c336-5640-409e-aed0-adcf0497b289 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:50.033079 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7eb1c336-5640-409e-aed0-adcf0497b289 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:50.033774 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7eb1c336-5640-409e-aed0-adcf0497b289 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:50.034234 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7eb1c336-5640-409e-aed0-adcf0497b289 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:50.034661 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7eb1c336-5640-409e-aed0-adcf0497b289 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:50.168001 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7eb1c336-5640-409e-aed0-adcf0497b289 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:50.176656 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7eb1c336-5640-409e-aed0-adcf0497b289 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:50.178207 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7eb1c336-5640-409e-aed0-adcf0497b289 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:50.179413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7eb1c336-5640-409e-aed0-adcf0497b289 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.157896 Aug 08 14:32:50.180068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 141/282] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:32:50 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:32:50.209801 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0825f78d-7f5c-4634-b8e8-b84f08ca7516 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:50.210993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-0825f78d-7f5c-4634-b8e8-b84f08ca7516 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:50.217218 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0825f78d-7f5c-4634-b8e8-b84f08ca7516 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:50.220573 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0825f78d-7f5c-4634-b8e8-b84f08ca7516 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:50.220573 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0825f78d-7f5c-4634-b8e8-b84f08ca7516 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:50.220573 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0825f78d-7f5c-4634-b8e8-b84f08ca7516 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:50.220573 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0825f78d-7f5c-4634-b8e8-b84f08ca7516 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:50.220865 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0825f78d-7f5c-4634-b8e8-b84f08ca7516 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:50.358907 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-0825f78d-7f5c-4634-b8e8-b84f08ca7516 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:50.366409 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0825f78d-7f5c-4634-b8e8-b84f08ca7516 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.160549 Aug 08 14:32:50.367004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 142/283] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:50 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:50.889222 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0a11b853-643e-4c4f-a270-b99a829a464d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:50.889858 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-0a11b853-643e-4c4f-a270-b99a829a464d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:50.892265 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:50.897401 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0a11b853-643e-4c4f-a270-b99a829a464d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:50.898374 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0a11b853-643e-4c4f-a270-b99a829a464d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:50.898805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0a11b853-643e-4c4f-a270-b99a829a464d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:50.899524 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0a11b853-643e-4c4f-a270-b99a829a464d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:50.899980 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0a11b853-643e-4c4f-a270-b99a829a464d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:50.900403 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0a11b853-643e-4c4f-a270-b99a829a464d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:51.029505 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-0a11b853-643e-4c4f-a270-b99a829a464d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:51.037050 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0a11b853-643e-4c4f-a270-b99a829a464d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.151700 Aug 08 14:32:51.037611 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 143/284] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:50 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:51.042606 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-37d37e75-650c-4501-b801-67fa2eb2b2f3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:51.043493 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-37d37e75-650c-4501-b801-67fa2eb2b2f3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:51.049124 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-37d37e75-650c-4501-b801-67fa2eb2b2f3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:51.049604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-37d37e75-650c-4501-b801-67fa2eb2b2f3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:51.050030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-37d37e75-650c-4501-b801-67fa2eb2b2f3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:51.050742 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-37d37e75-650c-4501-b801-67fa2eb2b2f3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:51.051220 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-37d37e75-650c-4501-b801-67fa2eb2b2f3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:51.051642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-37d37e75-650c-4501-b801-67fa2eb2b2f3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:51.185191 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-37d37e75-650c-4501-b801-67fa2eb2b2f3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:51.192478 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-37d37e75-650c-4501-b801-67fa2eb2b2f3 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1503 microversion: 2.1 time: 0.153947 Aug 08 14:32:51.193027 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 144/285] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:51 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:51.201296 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-100d011b-9d18-45fd-8c77-dd2bc5f62584 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:51.201920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-100d011b-9d18-45fd-8c77-dd2bc5f62584 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:51.207614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-100d011b-9d18-45fd-8c77-dd2bc5f62584 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:51.208097 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-100d011b-9d18-45fd-8c77-dd2bc5f62584 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:51.208534 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-100d011b-9d18-45fd-8c77-dd2bc5f62584 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:51.209221 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-100d011b-9d18-45fd-8c77-dd2bc5f62584 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:51.209677 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-100d011b-9d18-45fd-8c77-dd2bc5f62584 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:51.210097 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-100d011b-9d18-45fd-8c77-dd2bc5f62584 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:51.344200 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-100d011b-9d18-45fd-8c77-dd2bc5f62584 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:51.352080 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-100d011b-9d18-45fd-8c77-dd2bc5f62584 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:51.353609 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-100d011b-9d18-45fd-8c77-dd2bc5f62584 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:51.354867 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-100d011b-9d18-45fd-8c77-dd2bc5f62584 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.157139 Aug 08 14:32:51.355452 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 145/286] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:32:51 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:32:51.385782 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-929c6fb1-8aef-4e34-8904-3a6b0c6d4d6e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:51.386377 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-929c6fb1-8aef-4e34-8904-3a6b0c6d4d6e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:51.392323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-929c6fb1-8aef-4e34-8904-3a6b0c6d4d6e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:51.392798 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-929c6fb1-8aef-4e34-8904-3a6b0c6d4d6e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:51.393228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-929c6fb1-8aef-4e34-8904-3a6b0c6d4d6e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:51.393902 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-929c6fb1-8aef-4e34-8904-3a6b0c6d4d6e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:51.394354 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-929c6fb1-8aef-4e34-8904-3a6b0c6d4d6e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:51.394772 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-929c6fb1-8aef-4e34-8904-3a6b0c6d4d6e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:51.522626 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-929c6fb1-8aef-4e34-8904-3a6b0c6d4d6e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:51.530171 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-929c6fb1-8aef-4e34-8904-3a6b0c6d4d6e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.148441 Aug 08 14:32:51.530728 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 146/287] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:51 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:52.059108 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a9508026-7678-4b4b-839b-afeb27ec213a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:52.059773 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-a9508026-7678-4b4b-839b-afeb27ec213a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:52.066227 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a9508026-7678-4b4b-839b-afeb27ec213a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:52.066704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a9508026-7678-4b4b-839b-afeb27ec213a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:52.067168 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a9508026-7678-4b4b-839b-afeb27ec213a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:52.067852 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a9508026-7678-4b4b-839b-afeb27ec213a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:52.068298 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a9508026-7678-4b4b-839b-afeb27ec213a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:52.068726 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a9508026-7678-4b4b-839b-afeb27ec213a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:52.202898 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-a9508026-7678-4b4b-839b-afeb27ec213a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:52.211132 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-a9508026-7678-4b4b-839b-afeb27ec213a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.155872 Aug 08 14:32:52.211700 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 147/288] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:52 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:52.216088 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3a51de6c-7125-4134-9a4e-05375e65ee06 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:52.216688 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3a51de6c-7125-4134-9a4e-05375e65ee06 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:52.222721 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a51de6c-7125-4134-9a4e-05375e65ee06 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:52.223248 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a51de6c-7125-4134-9a4e-05375e65ee06 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:52.223722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a51de6c-7125-4134-9a4e-05375e65ee06 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:52.224385 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a51de6c-7125-4134-9a4e-05375e65ee06 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:52.224871 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a51de6c-7125-4134-9a4e-05375e65ee06 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:52.225376 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a51de6c-7125-4134-9a4e-05375e65ee06 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:52.360798 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3a51de6c-7125-4134-9a4e-05375e65ee06 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:52.368419 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3a51de6c-7125-4134-9a4e-05375e65ee06 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1503 microversion: 2.1 time: 0.155759 Aug 08 14:32:52.368977 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 148/289] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:52 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:52.378269 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b9e23568-35a4-4631-acae-3d347798f8eb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:52.379028 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b9e23568-35a4-4631-acae-3d347798f8eb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:52.385089 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b9e23568-35a4-4631-acae-3d347798f8eb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:52.385576 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b9e23568-35a4-4631-acae-3d347798f8eb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:52.386013 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b9e23568-35a4-4631-acae-3d347798f8eb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:52.386710 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b9e23568-35a4-4631-acae-3d347798f8eb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:52.387293 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b9e23568-35a4-4631-acae-3d347798f8eb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:52.387763 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b9e23568-35a4-4631-acae-3d347798f8eb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:52.522478 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b9e23568-35a4-4631-acae-3d347798f8eb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:52.530913 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b9e23568-35a4-4631-acae-3d347798f8eb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:52.532491 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b9e23568-35a4-4631-acae-3d347798f8eb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:52.533650 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b9e23568-35a4-4631-acae-3d347798f8eb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.159780 Aug 08 14:32:52.534220 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 149/290] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:32:52 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:32:52.550401 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-41738a01-dc6a-4bf2-9d49-29482d81ca23 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:52.551063 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-41738a01-dc6a-4bf2-9d49-29482d81ca23 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:52.557036 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-41738a01-dc6a-4bf2-9d49-29482d81ca23 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:52.557520 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-41738a01-dc6a-4bf2-9d49-29482d81ca23 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:52.557960 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-41738a01-dc6a-4bf2-9d49-29482d81ca23 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:52.558659 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-41738a01-dc6a-4bf2-9d49-29482d81ca23 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:52.559143 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-41738a01-dc6a-4bf2-9d49-29482d81ca23 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:52.559574 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-41738a01-dc6a-4bf2-9d49-29482d81ca23 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:52.700857 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-41738a01-dc6a-4bf2-9d49-29482d81ca23 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:52.709163 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-41738a01-dc6a-4bf2-9d49-29482d81ca23 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.162788 Aug 08 14:32:52.709746 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 150/291] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:52 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:52.974369 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4607a8b3-520f-403d-86f9-4abd4eede74e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ce0c35d-c1df-417e-9b83-a8e38e7f4b4d"}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:52.977292 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-4607a8b3-520f-403d-86f9-4abd4eede74e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:52.983307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4607a8b3-520f-403d-86f9-4abd4eede74e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:52.983787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4607a8b3-520f-403d-86f9-4abd4eede74e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:52.984225 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4607a8b3-520f-403d-86f9-4abd4eede74e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:52.984914 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4607a8b3-520f-403d-86f9-4abd4eede74e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:52.985369 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4607a8b3-520f-403d-86f9-4abd4eede74e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:52.985792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4607a8b3-520f-403d-86f9-4abd4eede74e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:53.002729 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=100 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:56.759519 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-221da94b-de1b-4d75-9ee9-fbea8634d4dd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "POST /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.280860 Aug 08 14:32:56.760140 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 142/292] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 14:32:48 2022] POST /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments => generated 194 bytes in 8283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:32:56.777845 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f068f4f0-111f-4c8e-804b-32e79ade7cea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:56.778541 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f068f4f0-111f-4c8e-804b-32e79ade7cea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:56.788049 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f068f4f0-111f-4c8e-804b-32e79ade7cea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:56.788982 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f068f4f0-111f-4c8e-804b-32e79ade7cea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:56.789748 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f068f4f0-111f-4c8e-804b-32e79ade7cea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:56.791019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f068f4f0-111f-4c8e-804b-32e79ade7cea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:56.792305 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f068f4f0-111f-4c8e-804b-32e79ade7cea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:56.793569 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f068f4f0-111f-4c8e-804b-32e79ade7cea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:56.810247 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-4607a8b3-520f-403d-86f9-4abd4eede74e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "POST /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.839228 Aug 08 14:32:56.817527 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 151/293] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 14:32:52 2022] POST /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/os-volume_attachments => generated 194 bytes in 3848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:32:56.826706 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-681af241-347c-4678-9a0b-ae8210c23e4c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:56.827613 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-681af241-347c-4678-9a0b-ae8210c23e4c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:56.837126 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-681af241-347c-4678-9a0b-ae8210c23e4c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:56.839335 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-681af241-347c-4678-9a0b-ae8210c23e4c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:56.839789 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-681af241-347c-4678-9a0b-ae8210c23e4c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:56.840703 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-681af241-347c-4678-9a0b-ae8210c23e4c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:56.841345 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-681af241-347c-4678-9a0b-ae8210c23e4c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:56.842028 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-681af241-347c-4678-9a0b-ae8210c23e4c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:57.088859 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f068f4f0-111f-4c8e-804b-32e79ade7cea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:57.096572 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f068f4f0-111f-4c8e-804b-32e79ade7cea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.335108 Aug 08 14:32:57.097139 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 143/294] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:56 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:57.102427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5756fe7b-6654-4a75-bbaa-068de4412e74 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:57.103368 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5756fe7b-6654-4a75-bbaa-068de4412e74 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:57.111376 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5756fe7b-6654-4a75-bbaa-068de4412e74 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:57.111951 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5756fe7b-6654-4a75-bbaa-068de4412e74 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:57.112721 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5756fe7b-6654-4a75-bbaa-068de4412e74 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:57.113451 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5756fe7b-6654-4a75-bbaa-068de4412e74 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:57.114015 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5756fe7b-6654-4a75-bbaa-068de4412e74 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:57.114439 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5756fe7b-6654-4a75-bbaa-068de4412e74 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:57.127851 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-681af241-347c-4678-9a0b-ae8210c23e4c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:57.135963 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-681af241-347c-4678-9a0b-ae8210c23e4c tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1503 microversion: 2.1 time: 0.316849 Aug 08 14:32:57.136875 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 152/295] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:56 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1503 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:57.142441 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7952bf2f-4fa4-4c60-a83e-d5cfbd448e1c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:57.143374 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7952bf2f-4fa4-4c60-a83e-d5cfbd448e1c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:57.150123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7952bf2f-4fa4-4c60-a83e-d5cfbd448e1c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:57.150902 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7952bf2f-4fa4-4c60-a83e-d5cfbd448e1c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:57.151422 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7952bf2f-4fa4-4c60-a83e-d5cfbd448e1c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:57.152337 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7952bf2f-4fa4-4c60-a83e-d5cfbd448e1c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:57.152860 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7952bf2f-4fa4-4c60-a83e-d5cfbd448e1c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:57.153493 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7952bf2f-4fa4-4c60-a83e-d5cfbd448e1c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:57.454877 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5756fe7b-6654-4a75-bbaa-068de4412e74 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:57.468298 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7952bf2f-4fa4-4c60-a83e-d5cfbd448e1c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:57.468696 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5756fe7b-6654-4a75-bbaa-068de4412e74 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:57.470361 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5756fe7b-6654-4a75-bbaa-068de4412e74 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:57.471835 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5756fe7b-6654-4a75-bbaa-068de4412e74 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.373582 Aug 08 14:32:57.472715 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 144/296] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:32:57 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:32:57.477731 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-2d0cd47b-df3d-4d8c-80f9-b8831a374b09 req-f99a0214-519d-4c5c-8cf7-239b5a67196d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0945eb52-f2d0-45fd-8217-6f251794bad8", "name": "network-vif-unplugged", "status": "completed", "tag": "2c011f55-7b8b-4997-a391-bc215a6aa450"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:57.478174 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7952bf2f-4fa4-4c60-a83e-d5cfbd448e1c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.339965 Aug 08 14:32:57.478805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 153/297] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:57 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:57.484712 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-968575665", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "networks": [{"uuid": "a2b2adbc-941f-4fb5-aefc-3ec0cd5b62e0"}]}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:57.500706 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2d0cd47b-df3d-4d8c-80f9-b8831a374b09 req-f99a0214-519d-4c5c-8cf7-239b5a67196d service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:57.501335 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2d0cd47b-df3d-4d8c-80f9-b8831a374b09 req-f99a0214-519d-4c5c-8cf7-239b5a67196d service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:57.501631 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2d0cd47b-df3d-4d8c-80f9-b8831a374b09 req-f99a0214-519d-4c5c-8cf7-239b5a67196d service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:57.515707 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-2d0cd47b-df3d-4d8c-80f9-b8831a374b09 req-f99a0214-519d-4c5c-8cf7-239b5a67196d service nova] Creating event network-vif-unplugged:2c011f55-7b8b-4997-a391-bc215a6aa450 for instance 0945eb52-f2d0-45fd-8217-6f251794bad8 on hv-cinder-85200 Aug 08 14:32:57.524790 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-2d0cd47b-df3d-4d8c-80f9-b8831a374b09 req-f99a0214-519d-4c5c-8cf7-239b5a67196d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047198 Aug 08 14:32:57.524790 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 145/298] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:57.531660 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-4ae3c626-900a-44f6-b171-9236ecf5cd9b req-ce6cf16c-8178-46d7-887b-71a393cd9b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0945eb52-f2d0-45fd-8217-6f251794bad8", "name": "network-vif-deleted", "tag": "2c011f55-7b8b-4997-a391-bc215a6aa450"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:32:57.545265 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-4ae3c626-900a-44f6-b171-9236ecf5cd9b req-ce6cf16c-8178-46d7-887b-71a393cd9b3a service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:57.546095 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-4ae3c626-900a-44f6-b171-9236ecf5cd9b req-ce6cf16c-8178-46d7-887b-71a393cd9b3a service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:57.546613 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-4ae3c626-900a-44f6-b171-9236ecf5cd9b req-ce6cf16c-8178-46d7-887b-71a393cd9b3a service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:57.561238 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-4ae3c626-900a-44f6-b171-9236ecf5cd9b req-ce6cf16c-8178-46d7-887b-71a393cd9b3a service nova] Creating event network-vif-deleted:2c011f55-7b8b-4997-a391-bc215a6aa450 for instance 0945eb52-f2d0-45fd-8217-6f251794bad8 on hv-cinder-85200 Aug 08 14:32:57.563815 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.network.neutron [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] validate_networks() for [('a2b2adbc-941f-4fb5-aefc-3ec0cd5b62e0', None, None, None, None, None)] {{(pid=118062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:32:57.566239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-4ae3c626-900a-44f6-b171-9236ecf5cd9b req-ce6cf16c-8178-46d7-887b-71a393cd9b3a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041999 Aug 08 14:32:57.567203 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 146/299] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:32:57.946785 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Flavor limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:32:57.947518 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Image limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:32:57.947997 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Flavor pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:32:57.948409 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Image pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:32:57.948822 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:32:57.958374 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:57.958863 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:57.959369 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:57.960096 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:57.960590 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:57.961014 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:57.978221 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Getting quotas for project 693b1fece5b548c786a495d2dc91bd8a. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:32:57.982161 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Getting quotas for user 57e1243ffa724189ba7d2b9277e10afd and project 693b1fece5b548c786a495d2dc91bd8a. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:32:57.993735 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Going to run 1 instances... {{(pid=118062) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:32:57.996034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:32:58.041559 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c5440ff6-2c3a-498e-8997-2c4a0e4edd42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561469 Aug 08 14:32:58.042237 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 154/300] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:32:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:32:58.053786 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-75ec8646-e7c5-4c98-8768-7f3eed8066e6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:58.055270 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-75ec8646-e7c5-4c98-8768-7f3eed8066e6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:58.112475 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-75ec8646-e7c5-4c98-8768-7f3eed8066e6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:58.119295 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3fb191b6-e5bf-49c6-9b3d-e4612e2f4697 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:58.120133 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3fb191b6-e5bf-49c6-9b3d-e4612e2f4697 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:58.121843 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-75ec8646-e7c5-4c98-8768-7f3eed8066e6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1218 microversion: 2.1 time: 0.072255 Aug 08 14:32:58.122428 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 147/301] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:58 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:58.138747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3fb191b6-e5bf-49c6-9b3d-e4612e2f4697 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:58.139357 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3fb191b6-e5bf-49c6-9b3d-e4612e2f4697 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:58.139697 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3fb191b6-e5bf-49c6-9b3d-e4612e2f4697 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:58.140432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3fb191b6-e5bf-49c6-9b3d-e4612e2f4697 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:58.140828 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3fb191b6-e5bf-49c6-9b3d-e4612e2f4697 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:58.141249 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3fb191b6-e5bf-49c6-9b3d-e4612e2f4697 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:58.167523 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8d562dcf-c583-4f1e-bf41-dc3a9d4b221f tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:58.168488 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8d562dcf-c583-4f1e-bf41-dc3a9d4b221f tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:58.171705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:32:58.177164 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d562dcf-c583-4f1e-bf41-dc3a9d4b221f tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:58.177676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d562dcf-c583-4f1e-bf41-dc3a9d4b221f tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:58.178115 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d562dcf-c583-4f1e-bf41-dc3a9d4b221f tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:58.178813 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d562dcf-c583-4f1e-bf41-dc3a9d4b221f tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:58.180305 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d562dcf-c583-4f1e-bf41-dc3a9d4b221f tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:58.180734 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d562dcf-c583-4f1e-bf41-dc3a9d4b221f tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:58.215126 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d562dcf-c583-4f1e-bf41-dc3a9d4b221f tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:58.215887 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d562dcf-c583-4f1e-bf41-dc3a9d4b221f tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:58.216486 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d562dcf-c583-4f1e-bf41-dc3a9d4b221f tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:58.216934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-8d562dcf-c583-4f1e-bf41-dc3a9d4b221f tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lazy-loading 'fault' on Instance uuid 0945eb52-f2d0-45fd-8217-6f251794bad8 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:32:58.278347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8d562dcf-c583-4f1e-bf41-dc3a9d4b221f tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:58.286530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8d562dcf-c583-4f1e-bf41-dc3a9d4b221f tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1303 microversion: 2.1 time: 0.127461 Aug 08 14:32:58.287945 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 148/302] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:58 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:58.322919 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3fb191b6-e5bf-49c6-9b3d-e4612e2f4697 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:58.331358 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3fb191b6-e5bf-49c6-9b3d-e4612e2f4697 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.216853 Aug 08 14:32:58.331940 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 155/303] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:58 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:58.496121 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-841a1145-04ba-4823-b29d-c0f07d22634a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:58.496732 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-841a1145-04ba-4823-b29d-c0f07d22634a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:58.504314 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-841a1145-04ba-4823-b29d-c0f07d22634a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:58.504779 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-841a1145-04ba-4823-b29d-c0f07d22634a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:58.505229 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-841a1145-04ba-4823-b29d-c0f07d22634a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:58.505916 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-841a1145-04ba-4823-b29d-c0f07d22634a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:58.506368 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-841a1145-04ba-4823-b29d-c0f07d22634a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:58.506794 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-841a1145-04ba-4823-b29d-c0f07d22634a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:58.507179 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-46a0c449-e71b-48f6-920a-cd161b2bf338 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:58.508329 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-46a0c449-e71b-48f6-920a-cd161b2bf338 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:58.514394 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46a0c449-e71b-48f6-920a-cd161b2bf338 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:58.514874 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46a0c449-e71b-48f6-920a-cd161b2bf338 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:58.515334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46a0c449-e71b-48f6-920a-cd161b2bf338 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:58.516030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46a0c449-e71b-48f6-920a-cd161b2bf338 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:58.516479 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46a0c449-e71b-48f6-920a-cd161b2bf338 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:58.516898 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46a0c449-e71b-48f6-920a-cd161b2bf338 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:58.709259 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-841a1145-04ba-4823-b29d-c0f07d22634a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:58.716703 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-46a0c449-e71b-48f6-920a-cd161b2bf338 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:58.718654 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-841a1145-04ba-4823-b29d-c0f07d22634a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:58.720432 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-841a1145-04ba-4823-b29d-c0f07d22634a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:58.721787 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-841a1145-04ba-4823-b29d-c0f07d22634a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.230340 Aug 08 14:32:58.723826 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 149/304] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:32:58 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:32:58.731931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-46a0c449-e71b-48f6-920a-cd161b2bf338 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.228439 Aug 08 14:32:58.737271 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 156/305] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:58 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:32:59.142031 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7fd96515-fc70-46c6-a42d-9f725ab74f7c tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:59.142650 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7fd96515-fc70-46c6-a42d-9f725ab74f7c tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:59.149544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7fd96515-fc70-46c6-a42d-9f725ab74f7c tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:59.149952 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7fd96515-fc70-46c6-a42d-9f725ab74f7c tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:59.150380 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7fd96515-fc70-46c6-a42d-9f725ab74f7c tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:59.151108 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7fd96515-fc70-46c6-a42d-9f725ab74f7c tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:59.151551 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7fd96515-fc70-46c6-a42d-9f725ab74f7c tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:59.151966 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7fd96515-fc70-46c6-a42d-9f725ab74f7c tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:59.308429 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-76b3a8a4-bf21-4daa-bd93-70214d386b15 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:59.309037 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-76b3a8a4-bf21-4daa-bd93-70214d386b15 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:59.315275 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-76b3a8a4-bf21-4daa-bd93-70214d386b15 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:59.315766 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-76b3a8a4-bf21-4daa-bd93-70214d386b15 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:59.316210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-76b3a8a4-bf21-4daa-bd93-70214d386b15 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:59.316909 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-76b3a8a4-bf21-4daa-bd93-70214d386b15 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:59.317404 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-76b3a8a4-bf21-4daa-bd93-70214d386b15 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:59.317827 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-76b3a8a4-bf21-4daa-bd93-70214d386b15 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:59.351182 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-76b3a8a4-bf21-4daa-bd93-70214d386b15 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:59.352046 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-76b3a8a4-bf21-4daa-bd93-70214d386b15 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:59.352481 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-76b3a8a4-bf21-4daa-bd93-70214d386b15 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:59.352939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-76b3a8a4-bf21-4daa-bd93-70214d386b15 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lazy-loading 'fault' on Instance uuid 0945eb52-f2d0-45fd-8217-6f251794bad8 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:32:59.354078 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7fd96515-fc70-46c6-a42d-9f725ab74f7c tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:59.361352 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7fd96515-fc70-46c6-a42d-9f725ab74f7c tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1222 microversion: 2.1 time: 0.223159 Aug 08 14:32:59.361915 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 150/306] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:59 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1222 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:59.366288 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-76070c17-c41b-4036-a1e3-0a22be120b9a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:59.366948 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-76070c17-c41b-4036-a1e3-0a22be120b9a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:59.372509 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76070c17-c41b-4036-a1e3-0a22be120b9a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:59.372982 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76070c17-c41b-4036-a1e3-0a22be120b9a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:59.373415 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76070c17-c41b-4036-a1e3-0a22be120b9a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:59.374093 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76070c17-c41b-4036-a1e3-0a22be120b9a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:59.374537 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76070c17-c41b-4036-a1e3-0a22be120b9a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:59.374962 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76070c17-c41b-4036-a1e3-0a22be120b9a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:59.406557 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-76b3a8a4-bf21-4daa-bd93-70214d386b15 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:59.414138 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-76b3a8a4-bf21-4daa-bd93-70214d386b15 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1303 microversion: 2.1 time: 0.109661 Aug 08 14:32:59.414726 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 157/307] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:59 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:59.503456 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-76070c17-c41b-4036-a1e3-0a22be120b9a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:59.511293 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-76070c17-c41b-4036-a1e3-0a22be120b9a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.148438 Aug 08 14:32:59.511844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 151/308] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:59 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:32:59.746426 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-11cf67c0-7ec8-4e0e-9659-2d538232f916 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:59.747158 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-11cf67c0-7ec8-4e0e-9659-2d538232f916 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:59.753665 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11cf67c0-7ec8-4e0e-9659-2d538232f916 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:59.754223 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11cf67c0-7ec8-4e0e-9659-2d538232f916 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:59.754591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11cf67c0-7ec8-4e0e-9659-2d538232f916 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:59.755321 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11cf67c0-7ec8-4e0e-9659-2d538232f916 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:59.755778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11cf67c0-7ec8-4e0e-9659-2d538232f916 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:59.756201 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11cf67c0-7ec8-4e0e-9659-2d538232f916 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:59.758666 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-667b0539-b1e3-4793-ba7d-c390a1e31236 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:32:59.759238 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-667b0539-b1e3-4793-ba7d-c390a1e31236 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:32:59.769511 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-667b0539-b1e3-4793-ba7d-c390a1e31236 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:59.770041 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-667b0539-b1e3-4793-ba7d-c390a1e31236 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:59.770474 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-667b0539-b1e3-4793-ba7d-c390a1e31236 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:59.771201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-667b0539-b1e3-4793-ba7d-c390a1e31236 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:32:59.771654 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-667b0539-b1e3-4793-ba7d-c390a1e31236 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:32:59.772069 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-667b0539-b1e3-4793-ba7d-c390a1e31236 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:32:59.967904 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-11cf67c0-7ec8-4e0e-9659-2d538232f916 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:59.972122 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-667b0539-b1e3-4793-ba7d-c390a1e31236 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:59.976040 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-11cf67c0-7ec8-4e0e-9659-2d538232f916 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:59.977655 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-11cf67c0-7ec8-4e0e-9659-2d538232f916 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:32:59.978823 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-11cf67c0-7ec8-4e0e-9659-2d538232f916 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.236878 Aug 08 14:32:59.979461 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 158/309] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:32:59 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:32:59.979599 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-667b0539-b1e3-4793-ba7d-c390a1e31236 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.225809 Aug 08 14:32:59.980309 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 152/310] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:32:59 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:00.381848 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7b9a78dd-0a7e-4be7-952d-e882308a6668 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:00.382495 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7b9a78dd-0a7e-4be7-952d-e882308a6668 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:00.388593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7b9a78dd-0a7e-4be7-952d-e882308a6668 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:00.389067 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7b9a78dd-0a7e-4be7-952d-e882308a6668 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:00.389501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7b9a78dd-0a7e-4be7-952d-e882308a6668 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:00.390181 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7b9a78dd-0a7e-4be7-952d-e882308a6668 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:00.390627 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7b9a78dd-0a7e-4be7-952d-e882308a6668 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:00.391044 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7b9a78dd-0a7e-4be7-952d-e882308a6668 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:00.435311 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3e71f3b7-887e-4bf9-93ef-a3e3feb45a63 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:00.435947 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3e71f3b7-887e-4bf9-93ef-a3e3feb45a63 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:00.442369 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3e71f3b7-887e-4bf9-93ef-a3e3feb45a63 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:00.442851 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3e71f3b7-887e-4bf9-93ef-a3e3feb45a63 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:00.443314 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3e71f3b7-887e-4bf9-93ef-a3e3feb45a63 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:00.444010 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3e71f3b7-887e-4bf9-93ef-a3e3feb45a63 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:00.444468 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3e71f3b7-887e-4bf9-93ef-a3e3feb45a63 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:00.444889 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3e71f3b7-887e-4bf9-93ef-a3e3feb45a63 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:00.451765 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7b9a78dd-0a7e-4be7-952d-e882308a6668 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:00.458998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7b9a78dd-0a7e-4be7-952d-e882308a6668 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1222 microversion: 2.1 time: 0.081075 Aug 08 14:33:00.459592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 159/311] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:00 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:00.476633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3e71f3b7-887e-4bf9-93ef-a3e3feb45a63 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:00.477115 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3e71f3b7-887e-4bf9-93ef-a3e3feb45a63 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:00.477545 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3e71f3b7-887e-4bf9-93ef-a3e3feb45a63 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:00.477983 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-3e71f3b7-887e-4bf9-93ef-a3e3feb45a63 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lazy-loading 'fault' on Instance uuid 0945eb52-f2d0-45fd-8217-6f251794bad8 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:33:00.518234 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3e71f3b7-887e-4bf9-93ef-a3e3feb45a63 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29b21ee2cd341169a2c8263393c5db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dae806b3c14f3fa1d2a491214de9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:00.526267 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3e71f3b7-887e-4bf9-93ef-a3e3feb45a63 tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 200 len: 1303 microversion: 2.1 time: 0.094950 Aug 08 14:33:00.526825 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 153/312] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:00 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:00.532394 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-632d5e53-6102-47b2-b741-0e812aba110b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:00.533080 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-632d5e53-6102-47b2-b741-0e812aba110b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:00.540596 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-632d5e53-6102-47b2-b741-0e812aba110b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:00.541269 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-632d5e53-6102-47b2-b741-0e812aba110b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:00.541764 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-632d5e53-6102-47b2-b741-0e812aba110b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:00.542819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-632d5e53-6102-47b2-b741-0e812aba110b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:00.543656 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-632d5e53-6102-47b2-b741-0e812aba110b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:00.544167 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-632d5e53-6102-47b2-b741-0e812aba110b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:00.701949 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-632d5e53-6102-47b2-b741-0e812aba110b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:00.710171 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-632d5e53-6102-47b2-b741-0e812aba110b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.181623 Aug 08 14:33:00.711303 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 160/313] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:00 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:01.000671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ff2bab49-688a-4a60-866e-b20a4159711a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:01.001279 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ff2bab49-688a-4a60-866e-b20a4159711a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:01.002204 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9ed89a44-01ba-4c9d-88ae-f6a9c481d177 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:01.002900 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9ed89a44-01ba-4c9d-88ae-f6a9c481d177 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:01.007420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ff2bab49-688a-4a60-866e-b20a4159711a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:01.007917 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ff2bab49-688a-4a60-866e-b20a4159711a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:01.008978 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ff2bab49-688a-4a60-866e-b20a4159711a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:01.009698 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ff2bab49-688a-4a60-866e-b20a4159711a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:01.010047 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ff2bab49-688a-4a60-866e-b20a4159711a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:01.010473 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ff2bab49-688a-4a60-866e-b20a4159711a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:01.011324 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9ed89a44-01ba-4c9d-88ae-f6a9c481d177 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:01.011832 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9ed89a44-01ba-4c9d-88ae-f6a9c481d177 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:01.013028 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9ed89a44-01ba-4c9d-88ae-f6a9c481d177 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:01.013756 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9ed89a44-01ba-4c9d-88ae-f6a9c481d177 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:01.015124 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9ed89a44-01ba-4c9d-88ae-f6a9c481d177 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:01.015124 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9ed89a44-01ba-4c9d-88ae-f6a9c481d177 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:01.215669 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ff2bab49-688a-4a60-866e-b20a4159711a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:01.219065 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:01.224340 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ff2bab49-688a-4a60-866e-b20a4159711a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.227615 Aug 08 14:33:01.224908 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 154/314] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:00 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:01.260213 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9ed89a44-01ba-4c9d-88ae-f6a9c481d177 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:01.268775 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9ed89a44-01ba-4c9d-88ae-f6a9c481d177 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:01.270466 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9ed89a44-01ba-4c9d-88ae-f6a9c481d177 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:01.271914 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9ed89a44-01ba-4c9d-88ae-f6a9c481d177 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.273915 Aug 08 14:33:01.272820 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 161/315] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:00 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:33:01.482168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f250edd4-4562-4c70-a9f9-eb0599e834e4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:01.482775 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f250edd4-4562-4c70-a9f9-eb0599e834e4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:01.490062 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f250edd4-4562-4c70-a9f9-eb0599e834e4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:01.490553 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f250edd4-4562-4c70-a9f9-eb0599e834e4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:01.490991 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f250edd4-4562-4c70-a9f9-eb0599e834e4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:01.491713 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f250edd4-4562-4c70-a9f9-eb0599e834e4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:01.492158 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f250edd4-4562-4c70-a9f9-eb0599e834e4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:01.492655 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f250edd4-4562-4c70-a9f9-eb0599e834e4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:01.548052 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1a6c94a7-a0c5-46e0-8885-289b4d504eda tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:01.548774 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1a6c94a7-a0c5-46e0-8885-289b4d504eda tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] [instance: 0945eb52-f2d0-45fd-8217-6f251794bad8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:01.565294 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1a6c94a7-a0c5-46e0-8885-289b4d504eda tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:01.565783 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1a6c94a7-a0c5-46e0-8885-289b4d504eda tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:01.566222 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1a6c94a7-a0c5-46e0-8885-289b4d504eda tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:01.566937 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1a6c94a7-a0c5-46e0-8885-289b4d504eda tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:01.567408 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1a6c94a7-a0c5-46e0-8885-289b4d504eda tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:01.567834 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1a6c94a7-a0c5-46e0-8885-289b4d504eda tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:01.581303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f250edd4-4562-4c70-a9f9-eb0599e834e4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:01.589399 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f250edd4-4562-4c70-a9f9-eb0599e834e4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1276 microversion: 2.1 time: 0.113077 Aug 08 14:33:01.590574 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 155/316] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:01 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:01.600120 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-1a6c94a7-a0c5-46e0-8885-289b4d504eda tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] HTTP exception thrown: Instance 0945eb52-f2d0-45fd-8217-6f251794bad8 could not be found. Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1a6c94a7-a0c5-46e0-8885-289b4d504eda tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Request method failure captured: Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 HTTP/1.1 Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R5g1AS42mxzt5LLSsTuiqp7ekuI7lbllLbALdsmTMCA5xLgdFfBZSuY9glZAMndcxEMEVAbBl7VZZNEEtaG92qtNv1c_ylQSVwXzWe8NK8tTx1E5iKnHpC1HxhMCvaqcUngK_IwQTOhi7TL3mliwOPJ6kXTOx6zm45p2f_itkX4nGQ Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: d6dae806b3c14f3fa1d2a491214de9f8 Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-VolumesActionsTest-790176281 Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:33:01.601792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:33:01.603633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d6dae806b3c14f3fa1d2a491214de9f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d6dae806b3c14f3fa1d2a491214de9f8", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6dae806b3c14f3fa1d2a491214de9f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6dae806b3c14f3fa1d2a491214de9f8"}]}] Aug 08 14:33:01.603633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-VolumesActionsTest-790176281 Aug 08 14:33:01.603633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: d6dae806b3c14f3fa1d2a491214de9f8 Aug 08 14:33:01.603633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-VolumesActionsTest-790176281 Aug 08 14:33:01.603633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-VolumesActionsTest-790176281-project Aug 08 14:33:01.603633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:33:01.603633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:33:01.603633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: c29b21ee2cd341169a2c8263393c5db6 Aug 08 14:33:01.603633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-VolumesActionsTest-790176281-project Aug 08 14:33:01.603633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:33:01.603633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance 0945eb52-f2d0-45fd-8217-6f251794bad8 could not be found. Aug 08 14:33:01.603633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': '0945eb52-f2d0-45fd-8217-6f251794bad8'} Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0945eb52-f2d0-45fd-8217-6f251794bad8 could not be found. Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:33:01.604538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0945eb52-f2d0-45fd-8217-6f251794bad8 could not be found. Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0945eb52-f2d0-45fd-8217-6f251794bad8 could not be found. Aug 08 14:33:01.606107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:33:01.607940 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1a6c94a7-a0c5-46e0-8885-289b4d504eda tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] Returning 404 to user: Instance 0945eb52-f2d0-45fd-8217-6f251794bad8 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:33:01.611642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1a6c94a7-a0c5-46e0-8885-289b4d504eda tempest-VolumesActionsTest-790176281 tempest-VolumesActionsTest-790176281-project] 10.222.0.50 "GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8" status: 404 len: 111 microversion: 2.1 time: 0.067626 Aug 08 14:33:01.612531 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 162/317] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:01 2022] GET /compute/v2.1/servers/0945eb52-f2d0-45fd-8217-6f251794bad8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:33:01.732832 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bab6a81e-c48d-4922-b5ed-f8b2526c35b1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:01.733440 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bab6a81e-c48d-4922-b5ed-f8b2526c35b1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:01.748374 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bab6a81e-c48d-4922-b5ed-f8b2526c35b1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:01.748867 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bab6a81e-c48d-4922-b5ed-f8b2526c35b1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:01.749303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bab6a81e-c48d-4922-b5ed-f8b2526c35b1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:01.750012 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bab6a81e-c48d-4922-b5ed-f8b2526c35b1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:01.750464 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bab6a81e-c48d-4922-b5ed-f8b2526c35b1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:01.750877 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bab6a81e-c48d-4922-b5ed-f8b2526c35b1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:02.083249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bab6a81e-c48d-4922-b5ed-f8b2526c35b1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:02.093869 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bab6a81e-c48d-4922-b5ed-f8b2526c35b1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.364837 Aug 08 14:33:02.094837 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 156/318] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:01 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:02.255730 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3096d957-0db1-4ae1-8765-1c098449d6d1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:02.256521 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3096d957-0db1-4ae1-8765-1c098449d6d1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:02.268462 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3096d957-0db1-4ae1-8765-1c098449d6d1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:02.268969 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3096d957-0db1-4ae1-8765-1c098449d6d1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:02.269413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3096d957-0db1-4ae1-8765-1c098449d6d1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:02.270127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3096d957-0db1-4ae1-8765-1c098449d6d1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:02.270750 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3096d957-0db1-4ae1-8765-1c098449d6d1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:02.271346 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3096d957-0db1-4ae1-8765-1c098449d6d1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:02.296361 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1eb563ab-86d7-48fc-9d99-fb0714c2f356 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:02.297182 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1eb563ab-86d7-48fc-9d99-fb0714c2f356 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:02.308649 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1eb563ab-86d7-48fc-9d99-fb0714c2f356 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:02.311264 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1eb563ab-86d7-48fc-9d99-fb0714c2f356 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:02.313148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1eb563ab-86d7-48fc-9d99-fb0714c2f356 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:02.317301 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1eb563ab-86d7-48fc-9d99-fb0714c2f356 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:02.318026 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1eb563ab-86d7-48fc-9d99-fb0714c2f356 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:02.318762 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1eb563ab-86d7-48fc-9d99-fb0714c2f356 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:02.671398 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3096d957-0db1-4ae1-8765-1c098449d6d1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:02.679987 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1eb563ab-86d7-48fc-9d99-fb0714c2f356 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:02.686535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3096d957-0db1-4ae1-8765-1c098449d6d1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.434900 Aug 08 14:33:02.688336 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 163/319] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:02 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:02.691503 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1eb563ab-86d7-48fc-9d99-fb0714c2f356 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:02.695165 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b236d452-7837-4e7a-a9f7-7fae5ca490f4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:02.696227 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b236d452-7837-4e7a-a9f7-7fae5ca490f4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:02.697733 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1eb563ab-86d7-48fc-9d99-fb0714c2f356 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:02.698980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1eb563ab-86d7-48fc-9d99-fb0714c2f356 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1741 microversion: 2.20 time: 0.408361 Aug 08 14:33:02.702447 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 157/320] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:02 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1741 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:02.706166 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b236d452-7837-4e7a-a9f7-7fae5ca490f4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:02.706755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b236d452-7837-4e7a-a9f7-7fae5ca490f4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:02.707303 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b236d452-7837-4e7a-a9f7-7fae5ca490f4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:02.708868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b236d452-7837-4e7a-a9f7-7fae5ca490f4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:02.709518 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b236d452-7837-4e7a-a9f7-7fae5ca490f4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:02.710344 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b236d452-7837-4e7a-a9f7-7fae5ca490f4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:02.808922 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-95ae3781-6268-4725-835d-cd8d27976e21 req-553d0391-e5d1-41e3-af24-c9f03d25238c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4173a09-ab1b-40aa-818f-5954b2c1bc6a", "name": "network-vif-plugged", "status": "completed", "tag": "23846c7c-43aa-487c-8739-8c59a0c6af7f"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:02.825467 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-95ae3781-6268-4725-835d-cd8d27976e21 req-553d0391-e5d1-41e3-af24-c9f03d25238c service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:02.830606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-95ae3781-6268-4725-835d-cd8d27976e21 req-553d0391-e5d1-41e3-af24-c9f03d25238c service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:02.832394 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-95ae3781-6268-4725-835d-cd8d27976e21 req-553d0391-e5d1-41e3-af24-c9f03d25238c service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:02.862567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-95ae3781-6268-4725-835d-cd8d27976e21 req-553d0391-e5d1-41e3-af24-c9f03d25238c service nova] Creating event network-vif-plugged:23846c7c-43aa-487c-8739-8c59a0c6af7f for instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a on hv-cinder-85200 Aug 08 14:33:02.871565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-95ae3781-6268-4725-835d-cd8d27976e21 req-553d0391-e5d1-41e3-af24-c9f03d25238c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066720 Aug 08 14:33:02.872573 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 158/321] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:33:02.965712 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b236d452-7837-4e7a-a9f7-7fae5ca490f4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:02.973378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b236d452-7837-4e7a-a9f7-7fae5ca490f4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1318 microversion: 2.1 time: 0.283751 Aug 08 14:33:02.973954 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 164/322] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:02 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:03.117280 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ba20ca63-5a57-4d30-9d70-12bcf7bbebd2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:03.117973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ba20ca63-5a57-4d30-9d70-12bcf7bbebd2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:03.125698 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba20ca63-5a57-4d30-9d70-12bcf7bbebd2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:03.126177 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba20ca63-5a57-4d30-9d70-12bcf7bbebd2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:03.126613 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba20ca63-5a57-4d30-9d70-12bcf7bbebd2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:03.127341 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba20ca63-5a57-4d30-9d70-12bcf7bbebd2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:03.128168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba20ca63-5a57-4d30-9d70-12bcf7bbebd2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:03.128604 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba20ca63-5a57-4d30-9d70-12bcf7bbebd2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:03.563107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ba20ca63-5a57-4d30-9d70-12bcf7bbebd2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:03.571907 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ba20ca63-5a57-4d30-9d70-12bcf7bbebd2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.458072 Aug 08 14:33:03.572608 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 159/323] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:03 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:03.590409 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-4284f28d-061c-4cc1-af2d-ba294197f1e2 req-7dd87f3a-e442-4240-be5f-d0b1f3e1ebd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47aa956f-cd4e-48b9-86f6-7ae42c470668", "tag": "be0f3565-2c11-49fe-9a87-e9ac3e0a83fe"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:03.600457 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-4284f28d-061c-4cc1-af2d-ba294197f1e2 req-7dd87f3a-e442-4240-be5f-d0b1f3e1ebd7 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:03.600943 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-4284f28d-061c-4cc1-af2d-ba294197f1e2 req-7dd87f3a-e442-4240-be5f-d0b1f3e1ebd7 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:03.601379 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-4284f28d-061c-4cc1-af2d-ba294197f1e2 req-7dd87f3a-e442-4240-be5f-d0b1f3e1ebd7 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:03.613305 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-4284f28d-061c-4cc1-af2d-ba294197f1e2 req-7dd87f3a-e442-4240-be5f-d0b1f3e1ebd7 service nova] Creating event network-changed:be0f3565-2c11-49fe-9a87-e9ac3e0a83fe for instance 47aa956f-cd4e-48b9-86f6-7ae42c470668 on hv-cinder-85200 Aug 08 14:33:03.618843 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-4284f28d-061c-4cc1-af2d-ba294197f1e2 req-7dd87f3a-e442-4240-be5f-d0b1f3e1ebd7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032118 Aug 08 14:33:03.619476 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 165/324] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:33:03.711389 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-99d71250-bcf8-4692-af62-b42b0c330762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:03.711988 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-99d71250-bcf8-4692-af62-b42b0c330762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:03.717860 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99d71250-bcf8-4692-af62-b42b0c330762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:03.718335 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99d71250-bcf8-4692-af62-b42b0c330762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:03.718766 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99d71250-bcf8-4692-af62-b42b0c330762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:03.719574 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99d71250-bcf8-4692-af62-b42b0c330762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:03.719998 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99d71250-bcf8-4692-af62-b42b0c330762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:03.720420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99d71250-bcf8-4692-af62-b42b0c330762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:03.725238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5abe930d-9f30-4fb7-a1b6-e1ba619e3fc9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:03.725979 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5abe930d-9f30-4fb7-a1b6-e1ba619e3fc9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:03.732176 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5abe930d-9f30-4fb7-a1b6-e1ba619e3fc9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:03.732775 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5abe930d-9f30-4fb7-a1b6-e1ba619e3fc9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:03.733102 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5abe930d-9f30-4fb7-a1b6-e1ba619e3fc9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:03.733802 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5abe930d-9f30-4fb7-a1b6-e1ba619e3fc9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:03.734259 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5abe930d-9f30-4fb7-a1b6-e1ba619e3fc9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:03.734686 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5abe930d-9f30-4fb7-a1b6-e1ba619e3fc9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:03.929747 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-99d71250-bcf8-4692-af62-b42b0c330762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:03.934439 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5abe930d-9f30-4fb7-a1b6-e1ba619e3fc9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:03.937860 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-99d71250-bcf8-4692-af62-b42b0c330762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.230308 Aug 08 14:33:03.938421 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 160/325] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:03 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:03.942463 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5abe930d-9f30-4fb7-a1b6-e1ba619e3fc9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:03.944044 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5abe930d-9f30-4fb7-a1b6-e1ba619e3fc9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:03.945212 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5abe930d-9f30-4fb7-a1b6-e1ba619e3fc9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1741 microversion: 2.20 time: 0.224243 Aug 08 14:33:03.945778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 166/326] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:03 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:33:03.995408 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-002781ab-58c9-40a9-bec5-500d56020ce9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:03.996012 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-002781ab-58c9-40a9-bec5-500d56020ce9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:04.002047 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-002781ab-58c9-40a9-bec5-500d56020ce9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:04.002520 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-002781ab-58c9-40a9-bec5-500d56020ce9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:04.002949 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-002781ab-58c9-40a9-bec5-500d56020ce9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:04.003659 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-002781ab-58c9-40a9-bec5-500d56020ce9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:04.004110 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-002781ab-58c9-40a9-bec5-500d56020ce9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:04.004588 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-002781ab-58c9-40a9-bec5-500d56020ce9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:04.131643 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-002781ab-58c9-40a9-bec5-500d56020ce9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:04.138989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-002781ab-58c9-40a9-bec5-500d56020ce9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1318 microversion: 2.1 time: 0.148264 Aug 08 14:33:04.139581 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 161/327] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:03 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:04.593593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-dfeefa69-0add-4de4-a725-ffe2440a6644 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:04.594228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-dfeefa69-0add-4de4-a725-ffe2440a6644 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:04.600877 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dfeefa69-0add-4de4-a725-ffe2440a6644 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:04.601369 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dfeefa69-0add-4de4-a725-ffe2440a6644 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:04.601814 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dfeefa69-0add-4de4-a725-ffe2440a6644 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:04.602518 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dfeefa69-0add-4de4-a725-ffe2440a6644 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:04.602978 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dfeefa69-0add-4de4-a725-ffe2440a6644 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:04.603448 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dfeefa69-0add-4de4-a725-ffe2440a6644 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:04.737502 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-dfeefa69-0add-4de4-a725-ffe2440a6644 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:04.744880 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-dfeefa69-0add-4de4-a725-ffe2440a6644 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.155458 Aug 08 14:33:04.745446 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 167/328] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:04 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:04.957607 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b2055e06-5df8-4da8-a011-2c58745d4690 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:04.958211 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b2055e06-5df8-4da8-a011-2c58745d4690 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:04.964670 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2055e06-5df8-4da8-a011-2c58745d4690 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:04.965164 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2055e06-5df8-4da8-a011-2c58745d4690 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:04.965613 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2055e06-5df8-4da8-a011-2c58745d4690 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:04.966401 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2055e06-5df8-4da8-a011-2c58745d4690 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:04.966856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2055e06-5df8-4da8-a011-2c58745d4690 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:04.967309 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2055e06-5df8-4da8-a011-2c58745d4690 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:04.967593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d6ce860a-1a22-4caf-9b23-2cda7d97e5fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:04.968193 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d6ce860a-1a22-4caf-9b23-2cda7d97e5fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:04.974026 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6ce860a-1a22-4caf-9b23-2cda7d97e5fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:04.974500 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6ce860a-1a22-4caf-9b23-2cda7d97e5fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:04.974934 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6ce860a-1a22-4caf-9b23-2cda7d97e5fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:04.975647 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6ce860a-1a22-4caf-9b23-2cda7d97e5fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:04.976100 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6ce860a-1a22-4caf-9b23-2cda7d97e5fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:04.976515 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6ce860a-1a22-4caf-9b23-2cda7d97e5fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:04.996482 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:05.169985 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b2055e06-5df8-4da8-a011-2c58745d4690 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:05.176772 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d6ce860a-1a22-4caf-9b23-2cda7d97e5fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:05.177584 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b2055e06-5df8-4da8-a011-2c58745d4690 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.223818 Aug 08 14:33:05.178158 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 162/329] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:04 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:05.183263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f2cd1bec-eb4d-46a7-be17-90082352fb27 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:05.183863 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f2cd1bec-eb4d-46a7-be17-90082352fb27 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:05.185525 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d6ce860a-1a22-4caf-9b23-2cda7d97e5fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:05.187084 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d6ce860a-1a22-4caf-9b23-2cda7d97e5fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:05.188295 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d6ce860a-1a22-4caf-9b23-2cda7d97e5fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1741 microversion: 2.20 time: 0.224541 Aug 08 14:33:05.189706 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2cd1bec-eb4d-46a7-be17-90082352fb27 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:05.190180 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2cd1bec-eb4d-46a7-be17-90082352fb27 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:05.190606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2cd1bec-eb4d-46a7-be17-90082352fb27 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:05.191019 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 168/330] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:04 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1741 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:33:05.191326 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2cd1bec-eb4d-46a7-be17-90082352fb27 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:05.191775 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2cd1bec-eb4d-46a7-be17-90082352fb27 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:05.192192 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2cd1bec-eb4d-46a7-be17-90082352fb27 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:05.328123 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f2cd1bec-eb4d-46a7-be17-90082352fb27 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:05.335939 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f2cd1bec-eb4d-46a7-be17-90082352fb27 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1318 microversion: 2.1 time: 0.156827 Aug 08 14:33:05.336574 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 163/331] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:05 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:05.765355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-cc32dc00-a574-454d-af7c-a98b7a7d9ea1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:05.765920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-cc32dc00-a574-454d-af7c-a98b7a7d9ea1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:05.772300 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cc32dc00-a574-454d-af7c-a98b7a7d9ea1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:05.772787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cc32dc00-a574-454d-af7c-a98b7a7d9ea1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:05.773226 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cc32dc00-a574-454d-af7c-a98b7a7d9ea1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:05.774411 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cc32dc00-a574-454d-af7c-a98b7a7d9ea1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:05.774873 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cc32dc00-a574-454d-af7c-a98b7a7d9ea1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:05.775333 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cc32dc00-a574-454d-af7c-a98b7a7d9ea1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:05.906393 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-cc32dc00-a574-454d-af7c-a98b7a7d9ea1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:05.914120 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-cc32dc00-a574-454d-af7c-a98b7a7d9ea1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.152689 Aug 08 14:33:05.915355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 169/332] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:05 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:06.198970 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f550690d-035a-4fef-9dde-210298a29c7e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:06.199630 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f550690d-035a-4fef-9dde-210298a29c7e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:06.205993 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f550690d-035a-4fef-9dde-210298a29c7e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:06.206473 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f550690d-035a-4fef-9dde-210298a29c7e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:06.206913 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f550690d-035a-4fef-9dde-210298a29c7e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:06.207648 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f550690d-035a-4fef-9dde-210298a29c7e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:06.208102 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f550690d-035a-4fef-9dde-210298a29c7e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:06.208530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f550690d-035a-4fef-9dde-210298a29c7e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:06.212214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-83b8e590-293b-46f7-8072-18ebd4ff8902 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:06.212817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-83b8e590-293b-46f7-8072-18ebd4ff8902 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:06.218574 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83b8e590-293b-46f7-8072-18ebd4ff8902 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:06.219054 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83b8e590-293b-46f7-8072-18ebd4ff8902 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:06.219518 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83b8e590-293b-46f7-8072-18ebd4ff8902 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:06.220266 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83b8e590-293b-46f7-8072-18ebd4ff8902 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:06.220665 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83b8e590-293b-46f7-8072-18ebd4ff8902 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:06.221088 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83b8e590-293b-46f7-8072-18ebd4ff8902 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:06.423610 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f550690d-035a-4fef-9dde-210298a29c7e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:06.427123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-83b8e590-293b-46f7-8072-18ebd4ff8902 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:06.431579 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f550690d-035a-4fef-9dde-210298a29c7e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.237022 Aug 08 14:33:06.432148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 164/333] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:06 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:06.435922 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-83b8e590-293b-46f7-8072-18ebd4ff8902 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:06.437173 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b3c86ef2-7ed6-41ba-9dfa-f754ffb2cf74 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:06.437450 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-83b8e590-293b-46f7-8072-18ebd4ff8902 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:06.437786 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b3c86ef2-7ed6-41ba-9dfa-f754ffb2cf74 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:06.438591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-83b8e590-293b-46f7-8072-18ebd4ff8902 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1741 microversion: 2.20 time: 0.230872 Aug 08 14:33:06.439151 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 170/334] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:06 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:06.447626 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b3c86ef2-7ed6-41ba-9dfa-f754ffb2cf74 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:06.448114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b3c86ef2-7ed6-41ba-9dfa-f754ffb2cf74 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:06.448547 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b3c86ef2-7ed6-41ba-9dfa-f754ffb2cf74 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:06.449359 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b3c86ef2-7ed6-41ba-9dfa-f754ffb2cf74 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:06.449758 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b3c86ef2-7ed6-41ba-9dfa-f754ffb2cf74 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:06.450176 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b3c86ef2-7ed6-41ba-9dfa-f754ffb2cf74 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:06.626974 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b3c86ef2-7ed6-41ba-9dfa-f754ffb2cf74 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:06.635569 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b3c86ef2-7ed6-41ba-9dfa-f754ffb2cf74 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1318 microversion: 2.1 time: 0.201851 Aug 08 14:33:06.636141 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 165/335] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:06 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:06.936337 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bf984945-d148-4025-85cc-d53bde31b6dd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:06.936972 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bf984945-d148-4025-85cc-d53bde31b6dd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:06.943413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bf984945-d148-4025-85cc-d53bde31b6dd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:06.943892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bf984945-d148-4025-85cc-d53bde31b6dd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:06.944325 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bf984945-d148-4025-85cc-d53bde31b6dd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:06.945010 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bf984945-d148-4025-85cc-d53bde31b6dd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:06.945466 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bf984945-d148-4025-85cc-d53bde31b6dd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:06.945912 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bf984945-d148-4025-85cc-d53bde31b6dd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:07.082086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bf984945-d148-4025-85cc-d53bde31b6dd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:07.089588 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bf984945-d148-4025-85cc-d53bde31b6dd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.157080 Aug 08 14:33:07.090159 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 171/336] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:06 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:07.452925 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-188f2f19-512a-4570-b815-c42d3a45d849 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:07.454099 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-188f2f19-512a-4570-b815-c42d3a45d849 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:07.463133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-188f2f19-512a-4570-b815-c42d3a45d849 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:07.463684 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2b5bbb24-3bf8-4885-ba3c-ea56c1ba905a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:07.464424 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-188f2f19-512a-4570-b815-c42d3a45d849 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:07.464650 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2b5bbb24-3bf8-4885-ba3c-ea56c1ba905a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:07.464879 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-188f2f19-512a-4570-b815-c42d3a45d849 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:07.465738 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-188f2f19-512a-4570-b815-c42d3a45d849 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:07.466193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-188f2f19-512a-4570-b815-c42d3a45d849 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:07.466631 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-188f2f19-512a-4570-b815-c42d3a45d849 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:07.472650 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b5bbb24-3bf8-4885-ba3c-ea56c1ba905a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:07.473312 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b5bbb24-3bf8-4885-ba3c-ea56c1ba905a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:07.473899 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b5bbb24-3bf8-4885-ba3c-ea56c1ba905a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:07.474828 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b5bbb24-3bf8-4885-ba3c-ea56c1ba905a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:07.475582 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b5bbb24-3bf8-4885-ba3c-ea56c1ba905a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:07.476324 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b5bbb24-3bf8-4885-ba3c-ea56c1ba905a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:07.702963 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-188f2f19-512a-4570-b815-c42d3a45d849 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:07.712269 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-188f2f19-512a-4570-b815-c42d3a45d849 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.263289 Aug 08 14:33:07.712859 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 166/337] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:07 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:07.735256 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-794a88ab-4b16-4422-bb37-5911ce72a868 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Action: 'create', calling method: .version_select at 0x7f9cb2613040>, body: {"keypair": {"name": "tempest-keypair-1234128508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0OTe+6Bn3Kr97aiu0S3N5Dr6jTtrV7U4HsODrtkqFAhYYq+9v4T32UOGH6E3+qh7qKDPNMVKVuvHQ2R4LZ7pOHwKVRbQyfga7wB5pTvxucmF4GZB6skXilVlk83qSsGg=="}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:07.749353 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2b5bbb24-3bf8-4885-ba3c-ea56c1ba905a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:07.751426 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-794a88ab-4b16-4422-bb37-5911ce72a868 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for project cfc86120e53145328dd430f542e73182. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:33:07.755519 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-794a88ab-4b16-4422-bb37-5911ce72a868 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for user 48a91f6797cc4604ba2606e0549234d0 and project cfc86120e53145328dd430f542e73182. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:33:07.762831 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2b5bbb24-3bf8-4885-ba3c-ea56c1ba905a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:07.766978 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2b5bbb24-3bf8-4885-ba3c-ea56c1ba905a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:07.771703 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2b5bbb24-3bf8-4885-ba3c-ea56c1ba905a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1736 microversion: 2.20 time: 0.313233 Aug 08 14:33:07.775910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 172/338] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:07 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1736 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:33:07.784116 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-857674ec-39f3-45b0-9552-53b03aa1f24e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:07.784651 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-857674ec-39f3-45b0-9552-53b03aa1f24e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:07.788251 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-794a88ab-4b16-4422-bb37-5911ce72a868 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057817 Aug 08 14:33:07.790458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 167/339] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 14:33:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:33:07.803209 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-857674ec-39f3-45b0-9552-53b03aa1f24e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:07.803918 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-857674ec-39f3-45b0-9552-53b03aa1f24e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:07.804794 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-857674ec-39f3-45b0-9552-53b03aa1f24e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:07.805692 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-857674ec-39f3-45b0-9552-53b03aa1f24e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:07.806349 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-857674ec-39f3-45b0-9552-53b03aa1f24e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:07.806922 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-857674ec-39f3-45b0-9552-53b03aa1f24e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:07.968935 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:07.985108 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-857674ec-39f3-45b0-9552-53b03aa1f24e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:07.989010 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=6 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:08.000249 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-857674ec-39f3-45b0-9552-53b03aa1f24e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1318 microversion: 2.1 time: 0.223216 Aug 08 14:33:08.000997 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 173/340] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:07 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:08.110398 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7d0db5d2-6626-493c-a4b6-93123eeebee6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:08.111295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7d0db5d2-6626-493c-a4b6-93123eeebee6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:08.120517 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7d0db5d2-6626-493c-a4b6-93123eeebee6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:08.121028 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7d0db5d2-6626-493c-a4b6-93123eeebee6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:08.123129 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7d0db5d2-6626-493c-a4b6-93123eeebee6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:08.124069 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7d0db5d2-6626-493c-a4b6-93123eeebee6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:08.124696 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7d0db5d2-6626-493c-a4b6-93123eeebee6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:08.125357 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7d0db5d2-6626-493c-a4b6-93123eeebee6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:08.425343 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7d0db5d2-6626-493c-a4b6-93123eeebee6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:08.437149 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7d0db5d2-6626-493c-a4b6-93123eeebee6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.330921 Aug 08 14:33:08.438342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 168/341] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:08 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:08.733269 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9a695db3-cc2c-4874-ab26-d514db979287 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:08.733929 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9a695db3-cc2c-4874-ab26-d514db979287 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:08.773972 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9a695db3-cc2c-4874-ab26-d514db979287 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:08.787900 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9a695db3-cc2c-4874-ab26-d514db979287 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:08.788639 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9a695db3-cc2c-4874-ab26-d514db979287 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:08.789610 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9a695db3-cc2c-4874-ab26-d514db979287 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:08.790245 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9a695db3-cc2c-4874-ab26-d514db979287 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:08.791582 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9a695db3-cc2c-4874-ab26-d514db979287 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:08.800464 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-29bc5d25-1632-4f33-9984-64684aa30eed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:08.801455 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-29bc5d25-1632-4f33-9984-64684aa30eed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:08.814255 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-29bc5d25-1632-4f33-9984-64684aa30eed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:08.817130 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-29bc5d25-1632-4f33-9984-64684aa30eed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:08.818609 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-29bc5d25-1632-4f33-9984-64684aa30eed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:08.821343 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-29bc5d25-1632-4f33-9984-64684aa30eed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:08.823584 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-29bc5d25-1632-4f33-9984-64684aa30eed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:08.825624 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-29bc5d25-1632-4f33-9984-64684aa30eed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:09.318874 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9a695db3-cc2c-4874-ab26-d514db979287 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:09.338163 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9a695db3-cc2c-4874-ab26-d514db979287 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1265 microversion: 2.1 time: 0.609151 Aug 08 14:33:09.343838 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 174/342] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:08 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1265 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:09.351625 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-02ced809-72cf-46e7-a5ad-93295e6343b1 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:09.352294 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-02ced809-72cf-46e7-a5ad-93295e6343b1 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:09.368933 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-02ced809-72cf-46e7-a5ad-93295e6343b1 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:09.369429 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-02ced809-72cf-46e7-a5ad-93295e6343b1 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:09.369949 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-02ced809-72cf-46e7-a5ad-93295e6343b1 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:09.370679 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-02ced809-72cf-46e7-a5ad-93295e6343b1 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:09.376738 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-02ced809-72cf-46e7-a5ad-93295e6343b1 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:09.378114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-02ced809-72cf-46e7-a5ad-93295e6343b1 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:09.552098 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-29bc5d25-1632-4f33-9984-64684aa30eed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:09.562330 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-29bc5d25-1632-4f33-9984-64684aa30eed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:09.571560 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-29bc5d25-1632-4f33-9984-64684aa30eed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:09.588640 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-29bc5d25-1632-4f33-9984-64684aa30eed tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1736 microversion: 2.20 time: 0.792424 Aug 08 14:33:09.589244 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 169/343] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:08 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1736 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:33:09.604414 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-aa9cdb31-462b-4563-afbe-5c378ff64cf3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:09.605302 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-aa9cdb31-462b-4563-afbe-5c378ff64cf3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:09.615667 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa9cdb31-462b-4563-afbe-5c378ff64cf3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:09.620508 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa9cdb31-462b-4563-afbe-5c378ff64cf3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:09.621308 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa9cdb31-462b-4563-afbe-5c378ff64cf3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:09.622291 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa9cdb31-462b-4563-afbe-5c378ff64cf3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:09.622979 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa9cdb31-462b-4563-afbe-5c378ff64cf3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:09.623764 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa9cdb31-462b-4563-afbe-5c378ff64cf3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:10.101042 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-02ced809-72cf-46e7-a5ad-93295e6343b1 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:10.119556 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-02ced809-72cf-46e7-a5ad-93295e6343b1 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1318 microversion: 2.1 time: 0.774209 Aug 08 14:33:10.123084 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 175/344] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:09 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1318 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:10.133341 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-aa9cdb31-462b-4563-afbe-5c378ff64cf3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:10.142731 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-aa9cdb31-462b-4563-afbe-5c378ff64cf3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.542313 Aug 08 14:33:10.145592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-9998132a-a351-4edb-be3b-7227abb1d95e req-ddfb1229-753b-4b5d-944b-53335fa0e529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0245e7-b0d0-4fbe-a233-4b3e7768b94c", "name": "network-vif-plugged", "status": "completed", "tag": "87f964c5-59f7-49fd-885c-ebcb610ccd3e"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:10.160056 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 170/345] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:09 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:10.166238 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1410229836", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fc22420-3005-4d46-a261-c4b4ae68cba2"}], "security_groups": [{"name": "tempest-securitygroup--798866441"}], "key_name": "tempest-keypair-1234128508", "user_data": "}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:10.173355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-9998132a-a351-4edb-be3b-7227abb1d95e req-ddfb1229-753b-4b5d-944b-53335fa0e529 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:10.173844 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-9998132a-a351-4edb-be3b-7227abb1d95e req-ddfb1229-753b-4b5d-944b-53335fa0e529 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:10.174279 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-9998132a-a351-4edb-be3b-7227abb1d95e req-ddfb1229-753b-4b5d-944b-53335fa0e529 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:10.199035 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-9998132a-a351-4edb-be3b-7227abb1d95e req-ddfb1229-753b-4b5d-944b-53335fa0e529 service nova] Creating event network-vif-plugged:87f964c5-59f7-49fd-885c-ebcb610ccd3e for instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c on hv-cinder-85200 Aug 08 14:33:10.204366 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-9998132a-a351-4edb-be3b-7227abb1d95e req-ddfb1229-753b-4b5d-944b-53335fa0e529 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079902 Aug 08 14:33:10.205268 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 176/346] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:33:10.373991 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-66767f00-9d90-4906-89aa-298977dcf371 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:10.376418 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-66767f00-9d90-4906-89aa-298977dcf371 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:10.419215 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-66767f00-9d90-4906-89aa-298977dcf371 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:10.430402 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-66767f00-9d90-4906-89aa-298977dcf371 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:10.431219 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-66767f00-9d90-4906-89aa-298977dcf371 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:10.432005 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-66767f00-9d90-4906-89aa-298977dcf371 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:10.432481 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-66767f00-9d90-4906-89aa-298977dcf371 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:10.432950 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-66767f00-9d90-4906-89aa-298977dcf371 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:10.674898 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-66767f00-9d90-4906-89aa-298977dcf371 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:10.688384 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-66767f00-9d90-4906-89aa-298977dcf371 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1451 microversion: 2.1 time: 0.324075 Aug 08 14:33:10.703861 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 177/347] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:10 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1451 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:10.712363 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-944cd7bf-37af-4035-b664-a229f3283184 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:10.713207 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-944cd7bf-37af-4035-b664-a229f3283184 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:10.719935 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-944cd7bf-37af-4035-b664-a229f3283184 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:10.720632 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-944cd7bf-37af-4035-b664-a229f3283184 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:10.721276 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-944cd7bf-37af-4035-b664-a229f3283184 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:10.722393 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-944cd7bf-37af-4035-b664-a229f3283184 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:10.723026 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-944cd7bf-37af-4035-b664-a229f3283184 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:10.723923 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-944cd7bf-37af-4035-b664-a229f3283184 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:11.034684 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-944cd7bf-37af-4035-b664-a229f3283184 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:11.053681 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-944cd7bf-37af-4035-b664-a229f3283184 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:11.057587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-944cd7bf-37af-4035-b664-a229f3283184 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:11.059317 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-944cd7bf-37af-4035-b664-a229f3283184 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1736 microversion: 2.20 time: 0.354015 Aug 08 14:33:11.086848 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 178/348] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:10 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1736 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:11.092029 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-71a22b1d-d60e-48bf-8e5f-ada7bff6d5d5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:11.092662 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-71a22b1d-d60e-48bf-8e5f-ada7bff6d5d5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:11.113082 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71a22b1d-d60e-48bf-8e5f-ada7bff6d5d5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:11.113507 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71a22b1d-d60e-48bf-8e5f-ada7bff6d5d5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:11.113951 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71a22b1d-d60e-48bf-8e5f-ada7bff6d5d5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:11.114954 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71a22b1d-d60e-48bf-8e5f-ada7bff6d5d5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:11.117975 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71a22b1d-d60e-48bf-8e5f-ada7bff6d5d5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:11.118715 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71a22b1d-d60e-48bf-8e5f-ada7bff6d5d5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:11.384248 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-71a22b1d-d60e-48bf-8e5f-ada7bff6d5d5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:11.396194 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-71a22b1d-d60e-48bf-8e5f-ada7bff6d5d5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1451 microversion: 2.1 time: 0.307465 Aug 08 14:33:11.413514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 179/349] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:11 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1451 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:11.426508 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-04311d63-ab98-45b4-8a10-96980731daa7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:11.428137 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-04311d63-ab98-45b4-8a10-96980731daa7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:11.435500 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-04311d63-ab98-45b4-8a10-96980731daa7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:11.436226 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-04311d63-ab98-45b4-8a10-96980731daa7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:11.436839 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-04311d63-ab98-45b4-8a10-96980731daa7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:11.438625 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-04311d63-ab98-45b4-8a10-96980731daa7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:11.439506 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-04311d63-ab98-45b4-8a10-96980731daa7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:11.440114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-04311d63-ab98-45b4-8a10-96980731daa7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:11.765544 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-04311d63-ab98-45b4-8a10-96980731daa7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:11.776358 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-04311d63-ab98-45b4-8a10-96980731daa7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1318 microversion: 2.1 time: 0.359518 Aug 08 14:33:11.777833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 180/350] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:11 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:11.792432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6b48c2df-55c3-40c1-8701-5ccb4042a11a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:11.799941 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6b48c2df-55c3-40c1-8701-5ccb4042a11a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:11.817097 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b48c2df-55c3-40c1-8701-5ccb4042a11a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:11.817784 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b48c2df-55c3-40c1-8701-5ccb4042a11a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:11.818615 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b48c2df-55c3-40c1-8701-5ccb4042a11a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:11.819736 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b48c2df-55c3-40c1-8701-5ccb4042a11a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:11.821179 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b48c2df-55c3-40c1-8701-5ccb4042a11a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:11.821905 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b48c2df-55c3-40c1-8701-5ccb4042a11a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:12.291575 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6b48c2df-55c3-40c1-8701-5ccb4042a11a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:12.300990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6b48c2df-55c3-40c1-8701-5ccb4042a11a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.512710 Aug 08 14:33:12.301577 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 181/351] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:11 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:12.318842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-24b1df82-4adc-4e88-89df-319b3a3742cb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:12.322490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-24b1df82-4adc-4e88-89df-319b3a3742cb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:12.332129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-24b1df82-4adc-4e88-89df-319b3a3742cb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:12.335201 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-24b1df82-4adc-4e88-89df-319b3a3742cb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:12.336093 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-24b1df82-4adc-4e88-89df-319b3a3742cb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:12.337005 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-24b1df82-4adc-4e88-89df-319b3a3742cb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:12.337645 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-24b1df82-4adc-4e88-89df-319b3a3742cb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:12.338420 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-24b1df82-4adc-4e88-89df-319b3a3742cb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:13.121208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-24b1df82-4adc-4e88-89df-319b3a3742cb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:13.129964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-24b1df82-4adc-4e88-89df-319b3a3742cb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:13.131819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-24b1df82-4adc-4e88-89df-319b3a3742cb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:13.133188 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-24b1df82-4adc-4e88-89df-319b3a3742cb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1736 microversion: 2.20 time: 0.819527 Aug 08 14:33:13.133908 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 182/352] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:12 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1736 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:13.138781 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-22b833ad-e6da-486f-ab42-6d39af220e94 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:13.139797 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-22b833ad-e6da-486f-ab42-6d39af220e94 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:13.146249 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22b833ad-e6da-486f-ab42-6d39af220e94 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:13.146950 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22b833ad-e6da-486f-ab42-6d39af220e94 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:13.147568 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22b833ad-e6da-486f-ab42-6d39af220e94 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:13.148426 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22b833ad-e6da-486f-ab42-6d39af220e94 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:13.149577 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22b833ad-e6da-486f-ab42-6d39af220e94 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:13.150149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22b833ad-e6da-486f-ab42-6d39af220e94 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:13.465752 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-22b833ad-e6da-486f-ab42-6d39af220e94 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:13.505489 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-22b833ad-e6da-486f-ab42-6d39af220e94 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1318 microversion: 2.1 time: 0.364059 Aug 08 14:33:13.506419 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 183/353] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:13 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:13.523179 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9e22e737-e0a2-4637-90cc-7f836e99a5d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:13.528554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9e22e737-e0a2-4637-90cc-7f836e99a5d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:13.561725 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e22e737-e0a2-4637-90cc-7f836e99a5d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:13.562914 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e22e737-e0a2-4637-90cc-7f836e99a5d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:13.568503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e22e737-e0a2-4637-90cc-7f836e99a5d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:13.569647 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e22e737-e0a2-4637-90cc-7f836e99a5d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:13.570347 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e22e737-e0a2-4637-90cc-7f836e99a5d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:13.571318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e22e737-e0a2-4637-90cc-7f836e99a5d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:14.218979 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9e22e737-e0a2-4637-90cc-7f836e99a5d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:14.228426 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9e22e737-e0a2-4637-90cc-7f836e99a5d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.720136 Aug 08 14:33:14.235299 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 184/354] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:13 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:14.250549 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-eb488fd6-ab4c-414e-9517-76f0bdb85fbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:14.264149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-eb488fd6-ab4c-414e-9517-76f0bdb85fbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:14.282704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:14.303110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb488fd6-ab4c-414e-9517-76f0bdb85fbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:14.304220 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb488fd6-ab4c-414e-9517-76f0bdb85fbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:14.305208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb488fd6-ab4c-414e-9517-76f0bdb85fbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:14.306579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb488fd6-ab4c-414e-9517-76f0bdb85fbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:14.308313 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb488fd6-ab4c-414e-9517-76f0bdb85fbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:14.309005 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb488fd6-ab4c-414e-9517-76f0bdb85fbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:15.264332 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-eb488fd6-ab4c-414e-9517-76f0bdb85fbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:15.269119 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=100 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:15.283845 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-eb488fd6-ab4c-414e-9517-76f0bdb85fbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:15.287710 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-eb488fd6-ab4c-414e-9517-76f0bdb85fbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:15.289660 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-eb488fd6-ab4c-414e-9517-76f0bdb85fbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1736 microversion: 2.20 time: 1.050083 Aug 08 14:33:15.312817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 185/355] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:14 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1736 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:15.326547 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-84349a39-2942-48cb-82f3-7f5850100d40 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:15.330854 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-84349a39-2942-48cb-82f3-7f5850100d40 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:15.345787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-84349a39-2942-48cb-82f3-7f5850100d40 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:15.346576 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-84349a39-2942-48cb-82f3-7f5850100d40 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:15.347215 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-84349a39-2942-48cb-82f3-7f5850100d40 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:15.349463 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-84349a39-2942-48cb-82f3-7f5850100d40 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:15.351713 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-84349a39-2942-48cb-82f3-7f5850100d40 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:15.352401 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-84349a39-2942-48cb-82f3-7f5850100d40 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:15.697712 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-84349a39-2942-48cb-82f3-7f5850100d40 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:15.726900 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-84349a39-2942-48cb-82f3-7f5850100d40 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1318 microversion: 2.1 time: 0.410727 Aug 08 14:33:15.727777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 186/356] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:15 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:15.748716 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bdc9221d-147d-467e-a052-14679869e73c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:15.749571 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bdc9221d-147d-467e-a052-14679869e73c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:15.756395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bdc9221d-147d-467e-a052-14679869e73c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:15.757127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bdc9221d-147d-467e-a052-14679869e73c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:15.757730 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bdc9221d-147d-467e-a052-14679869e73c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:15.759197 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bdc9221d-147d-467e-a052-14679869e73c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:15.759849 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bdc9221d-147d-467e-a052-14679869e73c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:15.760438 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bdc9221d-147d-467e-a052-14679869e73c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:16.134401 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bdc9221d-147d-467e-a052-14679869e73c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:16.150999 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bdc9221d-147d-467e-a052-14679869e73c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.405856 Aug 08 14:33:16.151952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 187/357] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:15 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:16.176824 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-22fba20c-1f41-4fd9-9874-23399a57e756 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:16.199493 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22fba20c-1f41-4fd9-9874-23399a57e756 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:16.200326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22fba20c-1f41-4fd9-9874-23399a57e756 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:16.201694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22fba20c-1f41-4fd9-9874-23399a57e756 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:16.371379 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-22fba20c-1f41-4fd9-9874-23399a57e756 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Going to try to stop instance {{(pid=118062) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 14:33:16.475260 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-22fba20c-1f41-4fd9-9874-23399a57e756 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "POST /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/action" status: 202 len: 0 microversion: 2.1 time: 0.311354 Aug 08 14:33:16.482826 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 188/358] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 14:33:16 2022] POST /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:33:16.513326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-29e04a72-f513-444f-bb63-d7d6dac0aa86 req-0a684638-a4a3-4aeb-a28e-46cff8b946f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47aa956f-cd4e-48b9-86f6-7ae42c470668", "name": "network-vif-plugged", "status": "completed", "tag": "be0f3565-2c11-49fe-9a87-e9ac3e0a83fe"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:16.548155 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-29e04a72-f513-444f-bb63-d7d6dac0aa86 req-0a684638-a4a3-4aeb-a28e-46cff8b946f3 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:16.549167 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-29e04a72-f513-444f-bb63-d7d6dac0aa86 req-0a684638-a4a3-4aeb-a28e-46cff8b946f3 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:16.551692 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-29e04a72-f513-444f-bb63-d7d6dac0aa86 req-0a684638-a4a3-4aeb-a28e-46cff8b946f3 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:16.609904 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-29e04a72-f513-444f-bb63-d7d6dac0aa86 req-0a684638-a4a3-4aeb-a28e-46cff8b946f3 service nova] Creating event network-vif-plugged:be0f3565-2c11-49fe-9a87-e9ac3e0a83fe for instance 47aa956f-cd4e-48b9-86f6-7ae42c470668 on hv-cinder-85200 Aug 08 14:33:16.625948 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-29e04a72-f513-444f-bb63-d7d6dac0aa86 req-0a684638-a4a3-4aeb-a28e-46cff8b946f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141045 Aug 08 14:33:16.626960 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 189/359] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:33:16.639331 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c33962b2-90f5-4d28-bacf-fe932fc2c6c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:16.652090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c33962b2-90f5-4d28-bacf-fe932fc2c6c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:16.669949 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c33962b2-90f5-4d28-bacf-fe932fc2c6c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:16.680708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c33962b2-90f5-4d28-bacf-fe932fc2c6c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:16.681819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c33962b2-90f5-4d28-bacf-fe932fc2c6c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:16.684125 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c33962b2-90f5-4d28-bacf-fe932fc2c6c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:16.687348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c33962b2-90f5-4d28-bacf-fe932fc2c6c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:16.688196 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c33962b2-90f5-4d28-bacf-fe932fc2c6c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:16.938727 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c33962b2-90f5-4d28-bacf-fe932fc2c6c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:16.949483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c33962b2-90f5-4d28-bacf-fe932fc2c6c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:16.951538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c33962b2-90f5-4d28-bacf-fe932fc2c6c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:16.952900 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c33962b2-90f5-4d28-bacf-fe932fc2c6c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1736 microversion: 2.20 time: 0.321577 Aug 08 14:33:16.953642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 190/360] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:16 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1736 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:16.958744 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-c4e7d944-7efd-4831-b1ac-a7eb67d95b60 req-906dc48f-aab0-42dc-ac00-2630b86a6f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4173a09-ab1b-40aa-818f-5954b2c1bc6a", "tag": "23846c7c-43aa-487c-8739-8c59a0c6af7f"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:16.970271 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-c4e7d944-7efd-4831-b1ac-a7eb67d95b60 req-906dc48f-aab0-42dc-ac00-2630b86a6f67 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:16.971250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-c4e7d944-7efd-4831-b1ac-a7eb67d95b60 req-906dc48f-aab0-42dc-ac00-2630b86a6f67 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:16.971793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-c4e7d944-7efd-4831-b1ac-a7eb67d95b60 req-906dc48f-aab0-42dc-ac00-2630b86a6f67 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:16.985255 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-c4e7d944-7efd-4831-b1ac-a7eb67d95b60 req-906dc48f-aab0-42dc-ac00-2630b86a6f67 service nova] Creating event network-changed:23846c7c-43aa-487c-8739-8c59a0c6af7f for instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a on hv-cinder-85200 Aug 08 14:33:16.992135 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-c4e7d944-7efd-4831-b1ac-a7eb67d95b60 req-906dc48f-aab0-42dc-ac00-2630b86a6f67 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036852 Aug 08 14:33:16.995874 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 191/361] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:33:17.009436 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0bad0c4b-989d-4480-a54d-fb5a96b52a2c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:17.011498 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-0bad0c4b-989d-4480-a54d-fb5a96b52a2c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:17.029356 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0bad0c4b-989d-4480-a54d-fb5a96b52a2c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:17.030558 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0bad0c4b-989d-4480-a54d-fb5a96b52a2c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:17.031697 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0bad0c4b-989d-4480-a54d-fb5a96b52a2c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:17.033766 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0bad0c4b-989d-4480-a54d-fb5a96b52a2c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:17.035960 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0bad0c4b-989d-4480-a54d-fb5a96b52a2c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:17.037101 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0bad0c4b-989d-4480-a54d-fb5a96b52a2c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:17.600030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-0bad0c4b-989d-4480-a54d-fb5a96b52a2c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:17.610670 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0bad0c4b-989d-4480-a54d-fb5a96b52a2c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1721 microversion: 2.1 time: 0.613436 Aug 08 14:33:17.613155 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 192/362] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:16 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1721 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:17.646401 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c6e17b36-2dd0-4b15-aa3a-8b8df5905c2b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:17.647777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c6e17b36-2dd0-4b15-aa3a-8b8df5905c2b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:17.668357 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6e17b36-2dd0-4b15-aa3a-8b8df5905c2b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:17.670357 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6e17b36-2dd0-4b15-aa3a-8b8df5905c2b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:17.672176 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6e17b36-2dd0-4b15-aa3a-8b8df5905c2b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:17.674277 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6e17b36-2dd0-4b15-aa3a-8b8df5905c2b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:17.675136 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6e17b36-2dd0-4b15-aa3a-8b8df5905c2b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:17.677232 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6e17b36-2dd0-4b15-aa3a-8b8df5905c2b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:17.772817 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=6 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:18.384513 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c6e17b36-2dd0-4b15-aa3a-8b8df5905c2b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:18.405917 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c6e17b36-2dd0-4b15-aa3a-8b8df5905c2b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1318 microversion: 2.1 time: 0.774006 Aug 08 14:33:18.420031 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 193/363] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:17 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1318 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:18.428088 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-78706b07-5525-46e7-8197-9c58597b5827 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:18.429116 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-78706b07-5525-46e7-8197-9c58597b5827 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:18.439822 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-78706b07-5525-46e7-8197-9c58597b5827 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:18.441039 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-78706b07-5525-46e7-8197-9c58597b5827 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:18.441723 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-78706b07-5525-46e7-8197-9c58597b5827 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:18.442676 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-78706b07-5525-46e7-8197-9c58597b5827 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:18.443416 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-78706b07-5525-46e7-8197-9c58597b5827 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:18.444064 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-78706b07-5525-46e7-8197-9c58597b5827 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:18.706869 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-78706b07-5525-46e7-8197-9c58597b5827 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:18.717227 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-78706b07-5525-46e7-8197-9c58597b5827 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.295132 Aug 08 14:33:18.720711 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 194/364] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:18 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:18.753061 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-babb720a-ac94-467f-8b20-8f3230a0a7e3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:18.753700 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-babb720a-ac94-467f-8b20-8f3230a0a7e3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:18.772849 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-babb720a-ac94-467f-8b20-8f3230a0a7e3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:18.773382 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-babb720a-ac94-467f-8b20-8f3230a0a7e3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:18.773830 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-babb720a-ac94-467f-8b20-8f3230a0a7e3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:18.774540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-babb720a-ac94-467f-8b20-8f3230a0a7e3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:18.774999 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-babb720a-ac94-467f-8b20-8f3230a0a7e3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:18.775453 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-babb720a-ac94-467f-8b20-8f3230a0a7e3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:19.277945 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-babb720a-ac94-467f-8b20-8f3230a0a7e3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:19.295969 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-babb720a-ac94-467f-8b20-8f3230a0a7e3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:19.297638 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-babb720a-ac94-467f-8b20-8f3230a0a7e3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:19.298863 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-babb720a-ac94-467f-8b20-8f3230a0a7e3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1736 microversion: 2.20 time: 0.570053 Aug 08 14:33:19.299456 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 195/365] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:18 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1736 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:19.305511 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c8e0463d-faea-40c5-883b-c9abeab2ae86 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:19.306119 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c8e0463d-faea-40c5-883b-c9abeab2ae86 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:19.321746 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c8e0463d-faea-40c5-883b-c9abeab2ae86 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:19.324447 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c8e0463d-faea-40c5-883b-c9abeab2ae86 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:19.324902 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c8e0463d-faea-40c5-883b-c9abeab2ae86 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:19.325642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c8e0463d-faea-40c5-883b-c9abeab2ae86 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:19.330345 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c8e0463d-faea-40c5-883b-c9abeab2ae86 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:19.330860 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c8e0463d-faea-40c5-883b-c9abeab2ae86 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:19.646347 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c8e0463d-faea-40c5-883b-c9abeab2ae86 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:19.656140 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c8e0463d-faea-40c5-883b-c9abeab2ae86 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1721 microversion: 2.1 time: 0.355617 Aug 08 14:33:19.678059 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 196/366] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:19 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1721 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:19.685403 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7bdd3b71-2402-4b7b-ba97-0f30167491ff tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:19.686042 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7bdd3b71-2402-4b7b-ba97-0f30167491ff tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:19.719313 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7bdd3b71-2402-4b7b-ba97-0f30167491ff tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:19.722221 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7bdd3b71-2402-4b7b-ba97-0f30167491ff tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:19.723079 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7bdd3b71-2402-4b7b-ba97-0f30167491ff tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:19.725841 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7bdd3b71-2402-4b7b-ba97-0f30167491ff tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:19.726347 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7bdd3b71-2402-4b7b-ba97-0f30167491ff tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:19.727356 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7bdd3b71-2402-4b7b-ba97-0f30167491ff tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:20.139252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=86 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:20.178438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:20.243718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7bdd3b71-2402-4b7b-ba97-0f30167491ff tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:20.256800 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7bdd3b71-2402-4b7b-ba97-0f30167491ff tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1507 microversion: 2.1 time: 0.586970 Aug 08 14:33:20.259283 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 197/367] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:19 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1507 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:20.265704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3bcb781c-5dc7-4a13-a4b9-42e3fdf7a59b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:20.266685 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3bcb781c-5dc7-4a13-a4b9-42e3fdf7a59b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:20.276958 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3bcb781c-5dc7-4a13-a4b9-42e3fdf7a59b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:20.277811 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3bcb781c-5dc7-4a13-a4b9-42e3fdf7a59b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:20.278412 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3bcb781c-5dc7-4a13-a4b9-42e3fdf7a59b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:20.279622 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3bcb781c-5dc7-4a13-a4b9-42e3fdf7a59b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:20.280235 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3bcb781c-5dc7-4a13-a4b9-42e3fdf7a59b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:20.281002 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3bcb781c-5dc7-4a13-a4b9-42e3fdf7a59b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:20.608094 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3bcb781c-5dc7-4a13-a4b9-42e3fdf7a59b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:20.620235 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3bcb781c-5dc7-4a13-a4b9-42e3fdf7a59b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.359535 Aug 08 14:33:20.623161 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 198/368] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:20 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:20.626620 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-65d51c8f-0074-41b9-81b7-9338ee87b089 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:20.641951 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-65d51c8f-0074-41b9-81b7-9338ee87b089 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:20.658068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65d51c8f-0074-41b9-81b7-9338ee87b089 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:20.658476 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65d51c8f-0074-41b9-81b7-9338ee87b089 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:20.658913 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65d51c8f-0074-41b9-81b7-9338ee87b089 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:20.659651 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65d51c8f-0074-41b9-81b7-9338ee87b089 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:20.660106 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65d51c8f-0074-41b9-81b7-9338ee87b089 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:20.660527 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65d51c8f-0074-41b9-81b7-9338ee87b089 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:21.113498 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-65d51c8f-0074-41b9-81b7-9338ee87b089 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:21.128693 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-65d51c8f-0074-41b9-81b7-9338ee87b089 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:21.131234 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-65d51c8f-0074-41b9-81b7-9338ee87b089 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:21.138439 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-65d51c8f-0074-41b9-81b7-9338ee87b089 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1736 microversion: 2.20 time: 0.515223 Aug 08 14:33:21.139210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 199/369] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:20 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1736 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:21.156632 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f20f4f44-9da2-4972-a1ec-b433c1b5b61e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:21.168083 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f20f4f44-9da2-4972-a1ec-b433c1b5b61e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:21.175004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f20f4f44-9da2-4972-a1ec-b433c1b5b61e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:21.175533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f20f4f44-9da2-4972-a1ec-b433c1b5b61e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:21.175971 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f20f4f44-9da2-4972-a1ec-b433c1b5b61e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:21.176686 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f20f4f44-9da2-4972-a1ec-b433c1b5b61e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:21.177144 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f20f4f44-9da2-4972-a1ec-b433c1b5b61e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:21.185090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f20f4f44-9da2-4972-a1ec-b433c1b5b61e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:21.547525 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f20f4f44-9da2-4972-a1ec-b433c1b5b61e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:21.557440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f20f4f44-9da2-4972-a1ec-b433c1b5b61e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1721 microversion: 2.1 time: 0.412812 Aug 08 14:33:21.581030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 200/370] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:21 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1721 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:21.641422 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-29593a88-ccae-47c6-97bb-5d9f93c391fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:21.643748 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-29593a88-ccae-47c6-97bb-5d9f93c391fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:21.652630 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29593a88-ccae-47c6-97bb-5d9f93c391fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:21.653422 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29593a88-ccae-47c6-97bb-5d9f93c391fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:21.654090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29593a88-ccae-47c6-97bb-5d9f93c391fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:21.654964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29593a88-ccae-47c6-97bb-5d9f93c391fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:21.655656 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29593a88-ccae-47c6-97bb-5d9f93c391fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:21.656260 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29593a88-ccae-47c6-97bb-5d9f93c391fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:22.122054 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-29593a88-ccae-47c6-97bb-5d9f93c391fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:22.131912 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-29593a88-ccae-47c6-97bb-5d9f93c391fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.494593 Aug 08 14:33:22.132507 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 201/371] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:21 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:22.164369 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f1498183-1df5-4c31-8121-b39339f72696 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:22.165184 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f1498183-1df5-4c31-8121-b39339f72696 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:22.172253 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f1498183-1df5-4c31-8121-b39339f72696 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:22.175057 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f1498183-1df5-4c31-8121-b39339f72696 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:22.180332 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f1498183-1df5-4c31-8121-b39339f72696 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:22.181608 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f1498183-1df5-4c31-8121-b39339f72696 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:22.182461 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f1498183-1df5-4c31-8121-b39339f72696 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:22.183330 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f1498183-1df5-4c31-8121-b39339f72696 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:22.612613 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f1498183-1df5-4c31-8121-b39339f72696 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:22.616540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:22.632717 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f1498183-1df5-4c31-8121-b39339f72696 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:22.636562 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f1498183-1df5-4c31-8121-b39339f72696 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:22.639400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f1498183-1df5-4c31-8121-b39339f72696 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1736 microversion: 2.20 time: 0.478738 Aug 08 14:33:22.642621 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 202/372] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:22 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1736 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:33:22.655023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-fd8ceb8f-d7ec-4e39-a570-4accc685faaa tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:22.656029 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-fd8ceb8f-d7ec-4e39-a570-4accc685faaa tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:22.675948 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fd8ceb8f-d7ec-4e39-a570-4accc685faaa tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:22.676699 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fd8ceb8f-d7ec-4e39-a570-4accc685faaa tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:22.677327 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fd8ceb8f-d7ec-4e39-a570-4accc685faaa tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:22.682239 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fd8ceb8f-d7ec-4e39-a570-4accc685faaa tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:22.682989 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fd8ceb8f-d7ec-4e39-a570-4accc685faaa tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:22.683608 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fd8ceb8f-d7ec-4e39-a570-4accc685faaa tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:23.050934 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-fd8ceb8f-d7ec-4e39-a570-4accc685faaa tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:23.060312 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-fd8ceb8f-d7ec-4e39-a570-4accc685faaa tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1721 microversion: 2.1 time: 0.415585 Aug 08 14:33:23.064418 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 203/373] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:22 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1721 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:23.156348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-90380679-791f-4cf7-9475-5cd1d211bae9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:23.158600 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-90380679-791f-4cf7-9475-5cd1d211bae9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:23.175879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90380679-791f-4cf7-9475-5cd1d211bae9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:23.176524 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90380679-791f-4cf7-9475-5cd1d211bae9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:23.176977 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90380679-791f-4cf7-9475-5cd1d211bae9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:23.178596 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90380679-791f-4cf7-9475-5cd1d211bae9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:23.179069 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90380679-791f-4cf7-9475-5cd1d211bae9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:23.180065 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90380679-791f-4cf7-9475-5cd1d211bae9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:23.589624 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-90380679-791f-4cf7-9475-5cd1d211bae9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:23.599252 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-90380679-791f-4cf7-9475-5cd1d211bae9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.448822 Aug 08 14:33:23.600563 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 204/374] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:23 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:23.669089 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-de62b610-4393-4de2-bb27-7e24c39f7102 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:23.671456 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-de62b610-4393-4de2-bb27-7e24c39f7102 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:23.680654 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-de62b610-4393-4de2-bb27-7e24c39f7102 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:23.682315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-de62b610-4393-4de2-bb27-7e24c39f7102 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:23.682988 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-de62b610-4393-4de2-bb27-7e24c39f7102 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:23.683972 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-de62b610-4393-4de2-bb27-7e24c39f7102 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:23.687899 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-de62b610-4393-4de2-bb27-7e24c39f7102 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:23.703974 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-de62b610-4393-4de2-bb27-7e24c39f7102 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:24.022360 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-de62b610-4393-4de2-bb27-7e24c39f7102 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:24.032824 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-de62b610-4393-4de2-bb27-7e24c39f7102 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:24.037093 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-de62b610-4393-4de2-bb27-7e24c39f7102 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:24.042354 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-de62b610-4393-4de2-bb27-7e24c39f7102 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1736 microversion: 2.20 time: 0.375691 Aug 08 14:33:24.043039 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 205/375] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:23 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1736 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:24.091826 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-96290db4-b0fd-4d53-a21e-f7eafa45c7bb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:24.092660 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-96290db4-b0fd-4d53-a21e-f7eafa45c7bb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:24.107014 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-96290db4-b0fd-4d53-a21e-f7eafa45c7bb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:24.109639 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-96290db4-b0fd-4d53-a21e-f7eafa45c7bb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:24.111548 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-96290db4-b0fd-4d53-a21e-f7eafa45c7bb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:24.113373 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-96290db4-b0fd-4d53-a21e-f7eafa45c7bb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:24.115583 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-96290db4-b0fd-4d53-a21e-f7eafa45c7bb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:24.119770 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-96290db4-b0fd-4d53-a21e-f7eafa45c7bb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:24.537126 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-96290db4-b0fd-4d53-a21e-f7eafa45c7bb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:24.558985 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-96290db4-b0fd-4d53-a21e-f7eafa45c7bb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1721 microversion: 2.1 time: 0.468163 Aug 08 14:33:24.561003 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 206/376] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:24 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1721 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:24.642151 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-22138b0b-e258-4b4a-8c3f-e3b68af861e1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:24.643246 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-22138b0b-e258-4b4a-8c3f-e3b68af861e1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:24.674393 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22138b0b-e258-4b4a-8c3f-e3b68af861e1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:24.676936 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22138b0b-e258-4b4a-8c3f-e3b68af861e1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:24.676936 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22138b0b-e258-4b4a-8c3f-e3b68af861e1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:24.678715 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22138b0b-e258-4b4a-8c3f-e3b68af861e1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:24.679889 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22138b0b-e258-4b4a-8c3f-e3b68af861e1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:24.680664 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22138b0b-e258-4b4a-8c3f-e3b68af861e1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:25.228454 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-22138b0b-e258-4b4a-8c3f-e3b68af861e1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:25.238087 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-22138b0b-e258-4b4a-8c3f-e3b68af861e1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.600648 Aug 08 14:33:25.238669 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 207/377] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:24 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:25.258143 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5a0099d3-f95f-4b0e-94dc-bd8f3af2b06f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:25.261671 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5a0099d3-f95f-4b0e-94dc-bd8f3af2b06f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:25.278275 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5a0099d3-f95f-4b0e-94dc-bd8f3af2b06f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:25.280876 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5a0099d3-f95f-4b0e-94dc-bd8f3af2b06f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:25.281599 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5a0099d3-f95f-4b0e-94dc-bd8f3af2b06f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:25.283520 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5a0099d3-f95f-4b0e-94dc-bd8f3af2b06f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:25.284910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5a0099d3-f95f-4b0e-94dc-bd8f3af2b06f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:25.285510 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5a0099d3-f95f-4b0e-94dc-bd8f3af2b06f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:25.616399 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5a0099d3-f95f-4b0e-94dc-bd8f3af2b06f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:25.625669 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5a0099d3-f95f-4b0e-94dc-bd8f3af2b06f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:25.629468 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5a0099d3-f95f-4b0e-94dc-bd8f3af2b06f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:25.631358 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5a0099d3-f95f-4b0e-94dc-bd8f3af2b06f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1736 microversion: 2.20 time: 0.390877 Aug 08 14:33:25.649609 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 208/378] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:25 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1736 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:25.658585 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-19f00c06-e4c6-49a4-94fa-cefbdc0e2bfb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:25.659503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-19f00c06-e4c6-49a4-94fa-cefbdc0e2bfb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:25.666286 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-19f00c06-e4c6-49a4-94fa-cefbdc0e2bfb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:25.667062 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-19f00c06-e4c6-49a4-94fa-cefbdc0e2bfb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:25.668360 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-19f00c06-e4c6-49a4-94fa-cefbdc0e2bfb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:25.669333 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-19f00c06-e4c6-49a4-94fa-cefbdc0e2bfb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:25.670002 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-19f00c06-e4c6-49a4-94fa-cefbdc0e2bfb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:25.670645 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-19f00c06-e4c6-49a4-94fa-cefbdc0e2bfb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:25.889430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-19f00c06-e4c6-49a4-94fa-cefbdc0e2bfb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:25.901750 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-19f00c06-e4c6-49a4-94fa-cefbdc0e2bfb tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1721 microversion: 2.1 time: 0.251028 Aug 08 14:33:25.902719 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 209/379] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:25 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1721 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:26.260554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-16393528-40a9-483e-b001-5fd22121cabd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:26.261275 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-16393528-40a9-483e-b001-5fd22121cabd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:26.272981 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16393528-40a9-483e-b001-5fd22121cabd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:26.273970 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16393528-40a9-483e-b001-5fd22121cabd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:26.277022 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16393528-40a9-483e-b001-5fd22121cabd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:26.278113 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16393528-40a9-483e-b001-5fd22121cabd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:26.279557 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16393528-40a9-483e-b001-5fd22121cabd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:26.283787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16393528-40a9-483e-b001-5fd22121cabd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:26.661704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-16393528-40a9-483e-b001-5fd22121cabd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:26.670494 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-16393528-40a9-483e-b001-5fd22121cabd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.415062 Aug 08 14:33:26.677520 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 210/380] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:26 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:26.700749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-59576bf7-3ac8-47ea-bdfc-d76bc15bdb69 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:26.702658 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-59576bf7-3ac8-47ea-bdfc-d76bc15bdb69 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:26.721636 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59576bf7-3ac8-47ea-bdfc-d76bc15bdb69 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:26.722801 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59576bf7-3ac8-47ea-bdfc-d76bc15bdb69 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:26.723814 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59576bf7-3ac8-47ea-bdfc-d76bc15bdb69 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:26.725835 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59576bf7-3ac8-47ea-bdfc-d76bc15bdb69 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:26.726748 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59576bf7-3ac8-47ea-bdfc-d76bc15bdb69 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:26.727701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59576bf7-3ac8-47ea-bdfc-d76bc15bdb69 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:26.944066 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-59576bf7-3ac8-47ea-bdfc-d76bc15bdb69 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:26.959813 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-59576bf7-3ac8-47ea-bdfc-d76bc15bdb69 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:26.963369 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-59576bf7-3ac8-47ea-bdfc-d76bc15bdb69 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:26.967297 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-59576bf7-3ac8-47ea-bdfc-d76bc15bdb69 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1736 microversion: 2.20 time: 0.287853 Aug 08 14:33:26.983670 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 211/381] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:26 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1736 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:26.989944 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b0c25309-293c-4cd4-92b9-59409a5fbeba tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:26.990902 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b0c25309-293c-4cd4-92b9-59409a5fbeba tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:26.998185 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b0c25309-293c-4cd4-92b9-59409a5fbeba tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:26.999017 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b0c25309-293c-4cd4-92b9-59409a5fbeba tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:26.999777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b0c25309-293c-4cd4-92b9-59409a5fbeba tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:27.000723 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b0c25309-293c-4cd4-92b9-59409a5fbeba tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:27.001385 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b0c25309-293c-4cd4-92b9-59409a5fbeba tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:27.002016 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b0c25309-293c-4cd4-92b9-59409a5fbeba tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:27.640584 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b0c25309-293c-4cd4-92b9-59409a5fbeba tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:27.653736 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b0c25309-293c-4cd4-92b9-59409a5fbeba tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1721 microversion: 2.1 time: 0.668401 Aug 08 14:33:27.654325 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 212/382] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:26 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1721 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:27.699268 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5441bf36-cb1b-4f6f-b202-f65363845e0e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:27.699937 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5441bf36-cb1b-4f6f-b202-f65363845e0e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:27.715490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5441bf36-cb1b-4f6f-b202-f65363845e0e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:27.719520 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5441bf36-cb1b-4f6f-b202-f65363845e0e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:27.733880 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5441bf36-cb1b-4f6f-b202-f65363845e0e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:27.735042 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5441bf36-cb1b-4f6f-b202-f65363845e0e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:27.736511 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5441bf36-cb1b-4f6f-b202-f65363845e0e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:27.737578 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5441bf36-cb1b-4f6f-b202-f65363845e0e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:28.019794 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] validate_networks() for [('3fc22420-3005-4d46-a261-c4b4ae68cba2', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:33:28.332888 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5441bf36-cb1b-4f6f-b202-f65363845e0e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:28.375368 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5441bf36-cb1b-4f6f-b202-f65363845e0e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 0.675236 Aug 08 14:33:28.387127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 213/383] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:27 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:28.401329 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-67ec0b92-438a-43ee-9b84-11795097d4d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:28.409767 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-67ec0b92-438a-43ee-9b84-11795097d4d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:28.442924 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67ec0b92-438a-43ee-9b84-11795097d4d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:28.443588 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67ec0b92-438a-43ee-9b84-11795097d4d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:28.444219 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67ec0b92-438a-43ee-9b84-11795097d4d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:28.445120 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67ec0b92-438a-43ee-9b84-11795097d4d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:28.445988 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67ec0b92-438a-43ee-9b84-11795097d4d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:28.454216 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67ec0b92-438a-43ee-9b84-11795097d4d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:29.822168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:33:29.823067 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:33:29.823067 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:33:29.823705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:33:29.824313 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:33:29.825940 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-67ec0b92-438a-43ee-9b84-11795097d4d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:29.839434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-67ec0b92-438a-43ee-9b84-11795097d4d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:29.842876 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-67ec0b92-438a-43ee-9b84-11795097d4d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:29.851907 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:29.854537 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:29.855456 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:29.856681 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:29.857478 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:29.858082 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:29.882761 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-67ec0b92-438a-43ee-9b84-11795097d4d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1736 microversion: 2.20 time: 1.494469 Aug 08 14:33:29.888422 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 214/384] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:28 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1736 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:29.892973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for project cfc86120e53145328dd430f542e73182. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:33:29.895767 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-791cf01e-f9ce-4eb5-b4ba-b610c875874f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:29.896827 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-791cf01e-f9ce-4eb5-b4ba-b610c875874f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:29.899623 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for user 48a91f6797cc4604ba2606e0549234d0 and project cfc86120e53145328dd430f542e73182. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:33:29.921300 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-791cf01e-f9ce-4eb5-b4ba-b610c875874f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:29.923066 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-791cf01e-f9ce-4eb5-b4ba-b610c875874f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:29.926841 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-791cf01e-f9ce-4eb5-b4ba-b610c875874f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:29.928027 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-791cf01e-f9ce-4eb5-b4ba-b610c875874f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:29.929348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-791cf01e-f9ce-4eb5-b4ba-b610c875874f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:29.930124 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-791cf01e-f9ce-4eb5-b4ba-b610c875874f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:29.938928 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:33:29.943033 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:33:30.060063 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2c61ec58-57fc-44b5-b05c-f19c675ae4b5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 19.898553 Aug 08 14:33:30.060945 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 171/385] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:33:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 19900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:33:30.068468 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a5e91664-1014-4d38-8e56-c62cb5c3a62f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:30.069327 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a5e91664-1014-4d38-8e56-c62cb5c3a62f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:30.077710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a5e91664-1014-4d38-8e56-c62cb5c3a62f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:30.078749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a5e91664-1014-4d38-8e56-c62cb5c3a62f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:30.079501 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a5e91664-1014-4d38-8e56-c62cb5c3a62f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:30.080498 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a5e91664-1014-4d38-8e56-c62cb5c3a62f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:30.081118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a5e91664-1014-4d38-8e56-c62cb5c3a62f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:30.081707 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a5e91664-1014-4d38-8e56-c62cb5c3a62f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:31.177260 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-791cf01e-f9ce-4eb5-b4ba-b610c875874f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:31.188873 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a5e91664-1014-4d38-8e56-c62cb5c3a62f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:31.192246 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-791cf01e-f9ce-4eb5-b4ba-b610c875874f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1721 microversion: 2.1 time: 1.301738 Aug 08 14:33:31.197865 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 215/386] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:29 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1721 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:31.203635 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bbc26883-cdb8-419d-97f3-03a04864b104 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:31.205040 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bbc26883-cdb8-419d-97f3-03a04864b104 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:31.224505 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a5e91664-1014-4d38-8e56-c62cb5c3a62f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1523 microversion: 2.1 time: 1.155964 Aug 08 14:33:31.247044 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 172/387] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:30 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1523 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:31.251535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bbc26883-cdb8-419d-97f3-03a04864b104 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:31.252037 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bbc26883-cdb8-419d-97f3-03a04864b104 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:31.253745 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bbc26883-cdb8-419d-97f3-03a04864b104 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:31.254696 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bbc26883-cdb8-419d-97f3-03a04864b104 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:31.257436 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bbc26883-cdb8-419d-97f3-03a04864b104 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:31.258061 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bbc26883-cdb8-419d-97f3-03a04864b104 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:31.258189 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9264729b-ec40-4899-ac29-643b708dc893 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:31.258870 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9264729b-ec40-4899-ac29-643b708dc893 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:31.278254 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9264729b-ec40-4899-ac29-643b708dc893 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:31.279248 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9264729b-ec40-4899-ac29-643b708dc893 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:31.280596 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9264729b-ec40-4899-ac29-643b708dc893 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:31.282167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9264729b-ec40-4899-ac29-643b708dc893 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:31.282974 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9264729b-ec40-4899-ac29-643b708dc893 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:31.283748 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9264729b-ec40-4899-ac29-643b708dc893 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:31.572861 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bbc26883-cdb8-419d-97f3-03a04864b104 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:31.581099 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bbc26883-cdb8-419d-97f3-03a04864b104 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1246 microversion: 2.1 time: 0.381742 Aug 08 14:33:31.581712 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 216/388] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:31 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1246 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:31.796613 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9264729b-ec40-4899-ac29-643b708dc893 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:31.813301 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9264729b-ec40-4899-ac29-643b708dc893 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:31.817679 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9264729b-ec40-4899-ac29-643b708dc893 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:31.821170 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9264729b-ec40-4899-ac29-643b708dc893 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1718 microversion: 2.20 time: 0.573015 Aug 08 14:33:31.841417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 173/389] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:31 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1718 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:32.057226 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-9e4804cd-0fb6-4ded-8a00-d0e8ab3c3e90 req-a5632f52-60ea-48a6-a067-93155c35bf4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0245e7-b0d0-4fbe-a233-4b3e7768b94c", "name": "network-vif-unplugged", "status": "completed", "tag": "87f964c5-59f7-49fd-885c-ebcb610ccd3e"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:32.075815 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-9e4804cd-0fb6-4ded-8a00-d0e8ab3c3e90 req-a5632f52-60ea-48a6-a067-93155c35bf4f service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:32.077061 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-9e4804cd-0fb6-4ded-8a00-d0e8ab3c3e90 req-a5632f52-60ea-48a6-a067-93155c35bf4f service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:32.077742 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-9e4804cd-0fb6-4ded-8a00-d0e8ab3c3e90 req-a5632f52-60ea-48a6-a067-93155c35bf4f service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:32.106939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-9e4804cd-0fb6-4ded-8a00-d0e8ab3c3e90 req-a5632f52-60ea-48a6-a067-93155c35bf4f service nova] Creating event network-vif-unplugged:87f964c5-59f7-49fd-885c-ebcb610ccd3e for instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c on hv-cinder-85200 Aug 08 14:33:32.117068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-9e4804cd-0fb6-4ded-8a00-d0e8ab3c3e90 req-a5632f52-60ea-48a6-a067-93155c35bf4f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067313 Aug 08 14:33:32.118868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 217/390] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:33:32.222799 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bf6dd02b-db46-4dd9-b000-5e5c90c190c4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:32.223785 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bf6dd02b-db46-4dd9-b000-5e5c90c190c4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:32.234214 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bf6dd02b-db46-4dd9-b000-5e5c90c190c4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:32.235071 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bf6dd02b-db46-4dd9-b000-5e5c90c190c4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:32.235748 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bf6dd02b-db46-4dd9-b000-5e5c90c190c4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:32.236644 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bf6dd02b-db46-4dd9-b000-5e5c90c190c4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:32.237278 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bf6dd02b-db46-4dd9-b000-5e5c90c190c4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:32.238168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bf6dd02b-db46-4dd9-b000-5e5c90c190c4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:32.249340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0a778f30-54c2-4648-8d8b-5492410010c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:32.250153 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-0a778f30-54c2-4648-8d8b-5492410010c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:32.270196 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0a778f30-54c2-4648-8d8b-5492410010c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:32.271369 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0a778f30-54c2-4648-8d8b-5492410010c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:32.274623 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0a778f30-54c2-4648-8d8b-5492410010c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:32.275886 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0a778f30-54c2-4648-8d8b-5492410010c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:32.277062 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0a778f30-54c2-4648-8d8b-5492410010c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:32.278709 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0a778f30-54c2-4648-8d8b-5492410010c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:32.742601 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-0a778f30-54c2-4648-8d8b-5492410010c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:32.750640 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0a778f30-54c2-4648-8d8b-5492410010c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1503 microversion: 2.1 time: 0.507549 Aug 08 14:33:32.756927 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 218/391] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:32 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1503 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:32.769468 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b79da168-19fc-43f7-80d4-3441a88b8911 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:32.771205 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b79da168-19fc-43f7-80d4-3441a88b8911 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:32.788066 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b79da168-19fc-43f7-80d4-3441a88b8911 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:32.789294 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b79da168-19fc-43f7-80d4-3441a88b8911 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:32.789936 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b79da168-19fc-43f7-80d4-3441a88b8911 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:32.790768 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b79da168-19fc-43f7-80d4-3441a88b8911 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:32.791334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b79da168-19fc-43f7-80d4-3441a88b8911 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:32.799214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b79da168-19fc-43f7-80d4-3441a88b8911 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:32.866955 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bf6dd02b-db46-4dd9-b000-5e5c90c190c4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:32.885572 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bf6dd02b-db46-4dd9-b000-5e5c90c190c4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1721 microversion: 2.1 time: 0.669201 Aug 08 14:33:32.896013 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 174/392] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:32 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1721 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:32.905652 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-652b539e-efb2-4575-bfc1-bf6c9bf4ca5d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:32.906262 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-652b539e-efb2-4575-bfc1-bf6c9bf4ca5d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:32.913055 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-652b539e-efb2-4575-bfc1-bf6c9bf4ca5d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:32.914317 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-652b539e-efb2-4575-bfc1-bf6c9bf4ca5d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:32.914929 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-652b539e-efb2-4575-bfc1-bf6c9bf4ca5d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:32.916543 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-652b539e-efb2-4575-bfc1-bf6c9bf4ca5d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:32.917147 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-652b539e-efb2-4575-bfc1-bf6c9bf4ca5d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:32.917983 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-652b539e-efb2-4575-bfc1-bf6c9bf4ca5d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:33.031237 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b79da168-19fc-43f7-80d4-3441a88b8911 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:33.053824 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b79da168-19fc-43f7-80d4-3441a88b8911 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1300 microversion: 2.1 time: 0.295335 Aug 08 14:33:33.057150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 219/393] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:32 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1300 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:33.062140 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3335c547-f807-4a8b-ae0b-a48fce626dfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:33.062965 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3335c547-f807-4a8b-ae0b-a48fce626dfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:33.071703 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3335c547-f807-4a8b-ae0b-a48fce626dfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:33.072460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3335c547-f807-4a8b-ae0b-a48fce626dfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:33.073230 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3335c547-f807-4a8b-ae0b-a48fce626dfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:33.074138 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3335c547-f807-4a8b-ae0b-a48fce626dfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:33.074781 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3335c547-f807-4a8b-ae0b-a48fce626dfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:33.075398 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3335c547-f807-4a8b-ae0b-a48fce626dfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:33.080725 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=100 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:33.403069 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-652b539e-efb2-4575-bfc1-bf6c9bf4ca5d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:33.417091 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-652b539e-efb2-4575-bfc1-bf6c9bf4ca5d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1516 microversion: 2.1 time: 0.515435 Aug 08 14:33:33.418608 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 175/394] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:32 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1516 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:33.442268 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3335c547-f807-4a8b-ae0b-a48fce626dfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:33.489565 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3335c547-f807-4a8b-ae0b-a48fce626dfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:33.505168 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3335c547-f807-4a8b-ae0b-a48fce626dfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:33.506611 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3335c547-f807-4a8b-ae0b-a48fce626dfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1718 microversion: 2.20 time: 0.448219 Aug 08 14:33:33.534227 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 220/395] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:33 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1718 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:33.917070 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-99d50c89-293c-41e3-abda-04e6713da68c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:33.918020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-99d50c89-293c-41e3-abda-04e6713da68c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:33.933333 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99d50c89-293c-41e3-abda-04e6713da68c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:33.933847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99d50c89-293c-41e3-abda-04e6713da68c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:33.934289 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99d50c89-293c-41e3-abda-04e6713da68c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:33.935013 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99d50c89-293c-41e3-abda-04e6713da68c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:33.937158 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99d50c89-293c-41e3-abda-04e6713da68c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:33.938452 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99d50c89-293c-41e3-abda-04e6713da68c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:34.082273 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6fd72e1c-c066-4bda-b825-0d9469a74785 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:34.083153 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6fd72e1c-c066-4bda-b825-0d9469a74785 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:34.095479 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6fd72e1c-c066-4bda-b825-0d9469a74785 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:34.102862 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6fd72e1c-c066-4bda-b825-0d9469a74785 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:34.103630 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6fd72e1c-c066-4bda-b825-0d9469a74785 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:34.108163 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6fd72e1c-c066-4bda-b825-0d9469a74785 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:34.112679 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6fd72e1c-c066-4bda-b825-0d9469a74785 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:34.116565 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6fd72e1c-c066-4bda-b825-0d9469a74785 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:34.236323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6fd72e1c-c066-4bda-b825-0d9469a74785 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:34.242944 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-99d50c89-293c-41e3-abda-04e6713da68c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:34.263695 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-99d50c89-293c-41e3-abda-04e6713da68c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1721 microversion: 2.1 time: 0.350332 Aug 08 14:33:34.264533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6fd72e1c-c066-4bda-b825-0d9469a74785 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1300 microversion: 2.1 time: 0.184795 Aug 08 14:33:34.267160 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 176/396] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:33 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1721 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:34.281803 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 221/397] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:34 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1300 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:34.535508 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d5835565-861d-463d-ac2b-d6a8fd5e433d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:34.536136 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d5835565-861d-463d-ac2b-d6a8fd5e433d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:34.545414 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d5835565-861d-463d-ac2b-d6a8fd5e433d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:34.546687 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d5835565-861d-463d-ac2b-d6a8fd5e433d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:34.547359 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d5835565-861d-463d-ac2b-d6a8fd5e433d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:34.548856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d5835565-861d-463d-ac2b-d6a8fd5e433d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:34.549539 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d5835565-861d-463d-ac2b-d6a8fd5e433d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:34.550706 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d5835565-861d-463d-ac2b-d6a8fd5e433d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:34.739995 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d5835565-861d-463d-ac2b-d6a8fd5e433d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:34.758501 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d5835565-861d-463d-ac2b-d6a8fd5e433d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:34.763246 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d5835565-861d-463d-ac2b-d6a8fd5e433d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:34.768269 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d5835565-861d-463d-ac2b-d6a8fd5e433d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1718 microversion: 2.20 time: 0.236889 Aug 08 14:33:34.769186 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 177/398] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:34 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1718 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:33:35.097409 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c4460d02-e0ad-4a09-b63e-3f2b8d6d94b7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:35.102091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c4460d02-e0ad-4a09-b63e-3f2b8d6d94b7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:35.108914 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c4460d02-e0ad-4a09-b63e-3f2b8d6d94b7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:35.109670 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c4460d02-e0ad-4a09-b63e-3f2b8d6d94b7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:35.110277 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c4460d02-e0ad-4a09-b63e-3f2b8d6d94b7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:35.111196 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c4460d02-e0ad-4a09-b63e-3f2b8d6d94b7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:35.111817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c4460d02-e0ad-4a09-b63e-3f2b8d6d94b7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:35.112403 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c4460d02-e0ad-4a09-b63e-3f2b8d6d94b7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:35.157881 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-c4460d02-e0ad-4a09-b63e-3f2b8d6d94b7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lazy-loading 'flavor' on Instance uuid e9f83a0c-1b6f-446f-96d5-804d508e2cf9 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:33:35.286997 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c9fd87d3-ae68-474a-894e-9588c6df7399 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:35.288008 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c9fd87d3-ae68-474a-894e-9588c6df7399 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:35.304185 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9fd87d3-ae68-474a-894e-9588c6df7399 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:35.305133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9fd87d3-ae68-474a-894e-9588c6df7399 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:35.307726 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9fd87d3-ae68-474a-894e-9588c6df7399 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:35.309091 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9fd87d3-ae68-474a-894e-9588c6df7399 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:35.312068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9fd87d3-ae68-474a-894e-9588c6df7399 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:35.315481 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9fd87d3-ae68-474a-894e-9588c6df7399 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:35.372932 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c4460d02-e0ad-4a09-b63e-3f2b8d6d94b7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "POST /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9/action" status: 200 len: 32 microversion: 2.1 time: 0.279477 Aug 08 14:33:35.375416 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 222/399] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 14:33:35 2022] POST /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 14:33:35.405817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-43035e7e-d0ab-4332-a80e-1a35c7300d31 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:35.407471 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-43035e7e-d0ab-4332-a80e-1a35c7300d31 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:35.431201 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-43035e7e-d0ab-4332-a80e-1a35c7300d31 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:35.432153 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-43035e7e-d0ab-4332-a80e-1a35c7300d31 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:35.433760 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-43035e7e-d0ab-4332-a80e-1a35c7300d31 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:35.436256 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-43035e7e-d0ab-4332-a80e-1a35c7300d31 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:35.437636 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-43035e7e-d0ab-4332-a80e-1a35c7300d31 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:35.438291 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-43035e7e-d0ab-4332-a80e-1a35c7300d31 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:35.649057 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-43035e7e-d0ab-4332-a80e-1a35c7300d31 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:35.661747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-43035e7e-d0ab-4332-a80e-1a35c7300d31 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1300 microversion: 2.1 time: 0.284766 Aug 08 14:33:35.677906 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 223/400] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:35 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1300 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:35.677906 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5e67c49b-df8c-465c-bfba-b1a8bcd6dc90 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:35.677906 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5e67c49b-df8c-465c-bfba-b1a8bcd6dc90 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:35.692809 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e67c49b-df8c-465c-bfba-b1a8bcd6dc90 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:35.693441 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e67c49b-df8c-465c-bfba-b1a8bcd6dc90 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:35.694000 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e67c49b-df8c-465c-bfba-b1a8bcd6dc90 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:35.695593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e67c49b-df8c-465c-bfba-b1a8bcd6dc90 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:35.698119 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e67c49b-df8c-465c-bfba-b1a8bcd6dc90 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:35.698705 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e67c49b-df8c-465c-bfba-b1a8bcd6dc90 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:36.298477 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c9fd87d3-ae68-474a-894e-9588c6df7399 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:36.307527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c9fd87d3-ae68-474a-894e-9588c6df7399 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1721 microversion: 2.1 time: 1.025487 Aug 08 14:33:36.308091 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 178/401] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:35 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1721 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:36.324625 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-64960af7-fa50-4172-8979-17a5d550670a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:36.325537 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-64960af7-fa50-4172-8979-17a5d550670a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:36.333154 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64960af7-fa50-4172-8979-17a5d550670a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:36.334237 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64960af7-fa50-4172-8979-17a5d550670a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:36.334930 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64960af7-fa50-4172-8979-17a5d550670a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:36.336197 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64960af7-fa50-4172-8979-17a5d550670a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:36.337161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64960af7-fa50-4172-8979-17a5d550670a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:36.337922 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64960af7-fa50-4172-8979-17a5d550670a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:36.396226 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5e67c49b-df8c-465c-bfba-b1a8bcd6dc90 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:36.407263 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5e67c49b-df8c-465c-bfba-b1a8bcd6dc90 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.740335 Aug 08 14:33:36.408859 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 224/402] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:35 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:36.808596 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-18f13282-fb78-4bb7-af28-7546231dd6c8 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Action: 'create', calling method: .version_select at 0x7f9cb25ee0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1152802890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSTpcNtUynhl6dzHQNMmvu/7QyKbHP3ro3crBgUA45Gem5r5CuXs2nB3ly3KXZ3QSx3/XvWoam+Cw7gml3SAwAGwy7oaDNwAgz2M6YNuVctq8iW/f+zmrq/BFAn6k0M2w=="}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:36.849332 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-18f13282-fb78-4bb7-af28-7546231dd6c8 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Getting quotas for project fb0c0d2823dd4a3fb35bb8c0cad4f410. Resources: {'key_pairs'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:33:36.854400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-18f13282-fb78-4bb7-af28-7546231dd6c8 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Getting quotas for user c376f5bd19c840b7924093606dee6f4f and project fb0c0d2823dd4a3fb35bb8c0cad4f410. Resources: {'key_pairs'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:33:36.917455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-18f13282-fb78-4bb7-af28-7546231dd6c8 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.506212 Aug 08 14:33:36.918916 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 225/403] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 14:33:36 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:33:36.923901 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4a1be580-a4b2-455f-ad6e-1841ea16da47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:36.925446 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-4a1be580-a4b2-455f-ad6e-1841ea16da47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:36.934228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4a1be580-a4b2-455f-ad6e-1841ea16da47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:36.935109 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4a1be580-a4b2-455f-ad6e-1841ea16da47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:36.936423 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4a1be580-a4b2-455f-ad6e-1841ea16da47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:36.937623 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4a1be580-a4b2-455f-ad6e-1841ea16da47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:36.938242 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4a1be580-a4b2-455f-ad6e-1841ea16da47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:36.938825 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4a1be580-a4b2-455f-ad6e-1841ea16da47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:37.027426 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-64960af7-fa50-4172-8979-17a5d550670a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:37.040734 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-64960af7-fa50-4172-8979-17a5d550670a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:37.044788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-64960af7-fa50-4172-8979-17a5d550670a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:37.051054 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-64960af7-fa50-4172-8979-17a5d550670a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1661 microversion: 2.20 time: 0.734518 Aug 08 14:33:37.052144 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 179/404] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:36 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1661 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:37.079169 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5e651c6e-c258-4ab6-b632-06535eff42b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f0d9763-b93e-42ee-8a50-7e37eb7efa76"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:37.086685 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5e651c6e-c258-4ab6-b632-06535eff42b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:37.100161 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4a1be580-a4b2-455f-ad6e-1841ea16da47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:37.113452 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e651c6e-c258-4ab6-b632-06535eff42b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:37.119772 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e651c6e-c258-4ab6-b632-06535eff42b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:37.121523 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e651c6e-c258-4ab6-b632-06535eff42b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:37.124652 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e651c6e-c258-4ab6-b632-06535eff42b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:37.126913 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e651c6e-c258-4ab6-b632-06535eff42b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:37.128363 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e651c6e-c258-4ab6-b632-06535eff42b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:37.157817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-4a1be580-a4b2-455f-ad6e-1841ea16da47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1300 microversion: 2.1 time: 0.236442 Aug 08 14:33:37.158460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 226/405] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:36 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1300 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:37.332667 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8e6d52fc-c75d-44e4-8cab-c0e7d9e7764f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:37.333833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8e6d52fc-c75d-44e4-8cab-c0e7d9e7764f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:37.353191 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8e6d52fc-c75d-44e4-8cab-c0e7d9e7764f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:37.353754 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8e6d52fc-c75d-44e4-8cab-c0e7d9e7764f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:37.355183 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8e6d52fc-c75d-44e4-8cab-c0e7d9e7764f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:37.355948 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8e6d52fc-c75d-44e4-8cab-c0e7d9e7764f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:37.358622 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8e6d52fc-c75d-44e4-8cab-c0e7d9e7764f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:37.359817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8e6d52fc-c75d-44e4-8cab-c0e7d9e7764f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:37.777313 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8e6d52fc-c75d-44e4-8cab-c0e7d9e7764f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:37.866173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8e6d52fc-c75d-44e4-8cab-c0e7d9e7764f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1698 microversion: 2.1 time: 0.538350 Aug 08 14:33:37.875983 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5e651c6e-c258-4ab6-b632-06535eff42b7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "POST /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.800617 Aug 08 14:33:37.880666 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 227/406] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:37 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1698 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:37.881206 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 180/407] 10.222.0.50 () {62 vars in 1364 bytes} [Mon Aug 8 14:33:37 2022] POST /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments => generated 188 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:33:37.904534 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2a85326b-3ade-463a-9c1a-634b5a853606 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:37.908561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-82b426ab-5e70-42fe-b93b-17a149457941 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:37.916774 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-82b426ab-5e70-42fe-b93b-17a149457941 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:37.931633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-82b426ab-5e70-42fe-b93b-17a149457941 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:37.932494 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-82b426ab-5e70-42fe-b93b-17a149457941 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:37.933189 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-82b426ab-5e70-42fe-b93b-17a149457941 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:37.933558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a85326b-3ade-463a-9c1a-634b5a853606 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:37.934065 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a85326b-3ade-463a-9c1a-634b5a853606 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:37.934505 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a85326b-3ade-463a-9c1a-634b5a853606 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:37.935385 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-82b426ab-5e70-42fe-b93b-17a149457941 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:37.936076 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-82b426ab-5e70-42fe-b93b-17a149457941 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:37.936749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-82b426ab-5e70-42fe-b93b-17a149457941 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:38.108945 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2a85326b-3ade-463a-9c1a-634b5a853606 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Going to try to start instance {{(pid=118060) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 14:33:38.196480 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2a85326b-3ade-463a-9c1a-634b5a853606 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "POST /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/action" status: 202 len: 0 microversion: 2.1 time: 0.298410 Aug 08 14:33:38.202666 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 181/408] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 14:33:37 2022] POST /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 14:33:38.211169 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-03bcaa4f-9ff0-4d8b-8cc5-45db1331e4f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:38.212223 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-03bcaa4f-9ff0-4d8b-8cc5-45db1331e4f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:38.221604 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03bcaa4f-9ff0-4d8b-8cc5-45db1331e4f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:38.222499 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03bcaa4f-9ff0-4d8b-8cc5-45db1331e4f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:38.223231 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03bcaa4f-9ff0-4d8b-8cc5-45db1331e4f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:38.230711 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03bcaa4f-9ff0-4d8b-8cc5-45db1331e4f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:38.232134 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03bcaa4f-9ff0-4d8b-8cc5-45db1331e4f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:38.233075 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03bcaa4f-9ff0-4d8b-8cc5-45db1331e4f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:38.361954 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-03bcaa4f-9ff0-4d8b-8cc5-45db1331e4f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118060) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 14:33:38.580997 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-03bcaa4f-9ff0-4d8b-8cc5-45db1331e4f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "POST /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/action" status: 202 len: 0 microversion: 2.20 time: 0.374852 Aug 08 14:33:38.587285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 182/409] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Aug 8 14:33:38 2022] POST /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:33:38.598022 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a982e249-a8de-4c16-81ff-6d372bbac12a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:38.598318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a982e249-a8de-4c16-81ff-6d372bbac12a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:38.614988 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a982e249-a8de-4c16-81ff-6d372bbac12a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:38.620539 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a982e249-a8de-4c16-81ff-6d372bbac12a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:38.621250 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a982e249-a8de-4c16-81ff-6d372bbac12a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:38.624080 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a982e249-a8de-4c16-81ff-6d372bbac12a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:38.626241 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a982e249-a8de-4c16-81ff-6d372bbac12a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:38.626978 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a982e249-a8de-4c16-81ff-6d372bbac12a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:38.697253 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:38.764779 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-82b426ab-5e70-42fe-b93b-17a149457941 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:38.777609 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-82b426ab-5e70-42fe-b93b-17a149457941 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.882483 Aug 08 14:33:38.779267 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 228/410] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:37 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:38.790650 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7d68e37e-38fa-47b7-8227-c1bf699c3604 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:38.793585 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7d68e37e-38fa-47b7-8227-c1bf699c3604 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:38.813450 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d68e37e-38fa-47b7-8227-c1bf699c3604 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:38.816348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d68e37e-38fa-47b7-8227-c1bf699c3604 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:38.817120 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d68e37e-38fa-47b7-8227-c1bf699c3604 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:38.820611 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d68e37e-38fa-47b7-8227-c1bf699c3604 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:38.822385 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d68e37e-38fa-47b7-8227-c1bf699c3604 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:38.823200 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d68e37e-38fa-47b7-8227-c1bf699c3604 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:39.266848 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a982e249-a8de-4c16-81ff-6d372bbac12a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:39.282417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a982e249-a8de-4c16-81ff-6d372bbac12a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.693830 Aug 08 14:33:39.287272 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 183/411] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:38 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:39.301836 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a2021cbb-1c26-4d24-aad0-6830dfd9df3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:39.305730 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a2021cbb-1c26-4d24-aad0-6830dfd9df3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:39.313885 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a2021cbb-1c26-4d24-aad0-6830dfd9df3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:39.315370 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a2021cbb-1c26-4d24-aad0-6830dfd9df3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:39.316066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a2021cbb-1c26-4d24-aad0-6830dfd9df3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:39.317006 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a2021cbb-1c26-4d24-aad0-6830dfd9df3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:39.317814 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a2021cbb-1c26-4d24-aad0-6830dfd9df3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:39.318444 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a2021cbb-1c26-4d24-aad0-6830dfd9df3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:39.321644 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7d68e37e-38fa-47b7-8227-c1bf699c3604 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:39.335178 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7d68e37e-38fa-47b7-8227-c1bf699c3604 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1707 microversion: 2.1 time: 0.554483 Aug 08 14:33:39.337819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 229/412] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:38 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1707 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:39.741164 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a2021cbb-1c26-4d24-aad0-6830dfd9df3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:39.755339 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a2021cbb-1c26-4d24-aad0-6830dfd9df3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:39.764954 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a2021cbb-1c26-4d24-aad0-6830dfd9df3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:39.768347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a2021cbb-1c26-4d24-aad0-6830dfd9df3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1747 microversion: 2.20 time: 0.477657 Aug 08 14:33:39.769220 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 184/413] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:39 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1747 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:39.800887 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-73b28956-6f5c-4497-a944-3ad4fe9968d2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:39.801706 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-73b28956-6f5c-4497-a944-3ad4fe9968d2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:39.810199 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:39.814085 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-73b28956-6f5c-4497-a944-3ad4fe9968d2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:39.816111 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-73b28956-6f5c-4497-a944-3ad4fe9968d2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:39.816659 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-73b28956-6f5c-4497-a944-3ad4fe9968d2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:39.817634 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-73b28956-6f5c-4497-a944-3ad4fe9968d2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:39.818736 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-73b28956-6f5c-4497-a944-3ad4fe9968d2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:39.822629 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-73b28956-6f5c-4497-a944-3ad4fe9968d2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:40.308859 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-120094ef-5a5a-4fc4-94c7-ac25640e9107 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:40.309999 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-120094ef-5a5a-4fc4-94c7-ac25640e9107 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:40.315743 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-73b28956-6f5c-4497-a944-3ad4fe9968d2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:40.326026 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:40.334316 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=6 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:40.335273 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-73b28956-6f5c-4497-a944-3ad4fe9968d2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.538497 Aug 08 14:33:40.341261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 230/414] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:39 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:40.344402 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-120094ef-5a5a-4fc4-94c7-ac25640e9107 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:40.347866 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-120094ef-5a5a-4fc4-94c7-ac25640e9107 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:40.348576 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-120094ef-5a5a-4fc4-94c7-ac25640e9107 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:40.350693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-120094ef-5a5a-4fc4-94c7-ac25640e9107 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:40.352757 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-120094ef-5a5a-4fc4-94c7-ac25640e9107 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:40.353439 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-120094ef-5a5a-4fc4-94c7-ac25640e9107 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:40.367271 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a3a546de-b925-4324-a3f3-9d301b53cdc3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:40.370149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-a3a546de-b925-4324-a3f3-9d301b53cdc3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:40.392854 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a3a546de-b925-4324-a3f3-9d301b53cdc3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:40.394862 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a3a546de-b925-4324-a3f3-9d301b53cdc3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:40.395553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a3a546de-b925-4324-a3f3-9d301b53cdc3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:40.402422 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a3a546de-b925-4324-a3f3-9d301b53cdc3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:40.406055 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a3a546de-b925-4324-a3f3-9d301b53cdc3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:40.406773 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a3a546de-b925-4324-a3f3-9d301b53cdc3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:40.759004 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-120094ef-5a5a-4fc4-94c7-ac25640e9107 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:40.798352 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-a3a546de-b925-4324-a3f3-9d301b53cdc3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:40.803495 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-120094ef-5a5a-4fc4-94c7-ac25640e9107 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.499120 Aug 08 14:33:40.805152 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 185/415] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:40 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:40.811480 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-6d8461b3-5499-4dfd-b3c6-b25f132cb0bc req-19a3c313-2c8e-4566-b9c3-e9976d24d3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c19ca8ed-1d03-4d63-9e99-900018554325", "tag": "a6c756df-1afd-4d0a-a280-181227b91c9d"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:40.825102 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-a3a546de-b925-4324-a3f3-9d301b53cdc3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1707 microversion: 2.1 time: 0.462178 Aug 08 14:33:40.826435 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-6d8461b3-5499-4dfd-b3c6-b25f132cb0bc req-19a3c313-2c8e-4566-b9c3-e9976d24d3a6 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:40.827170 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-6d8461b3-5499-4dfd-b3c6-b25f132cb0bc req-19a3c313-2c8e-4566-b9c3-e9976d24d3a6 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:40.827849 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-6d8461b3-5499-4dfd-b3c6-b25f132cb0bc req-19a3c313-2c8e-4566-b9c3-e9976d24d3a6 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:40.829134 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 231/416] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:40 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1707 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:40.852502 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2a6d60b6-4b1d-4d95-b31a-823e92af27ee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:40.854339 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2a6d60b6-4b1d-4d95-b31a-823e92af27ee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:40.862179 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2a6d60b6-4b1d-4d95-b31a-823e92af27ee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:40.864665 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-6d8461b3-5499-4dfd-b3c6-b25f132cb0bc req-19a3c313-2c8e-4566-b9c3-e9976d24d3a6 service nova] Creating event network-changed:a6c756df-1afd-4d0a-a280-181227b91c9d for instance c19ca8ed-1d03-4d63-9e99-900018554325 on hv-cinder-85200 Aug 08 14:33:40.870808 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2a6d60b6-4b1d-4d95-b31a-823e92af27ee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:40.871119 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-6d8461b3-5499-4dfd-b3c6-b25f132cb0bc req-19a3c313-2c8e-4566-b9c3-e9976d24d3a6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064174 Aug 08 14:33:40.871319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2a6d60b6-4b1d-4d95-b31a-823e92af27ee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:40.871721 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 186/417] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:33:40.872082 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2a6d60b6-4b1d-4d95-b31a-823e92af27ee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:40.873164 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2a6d60b6-4b1d-4d95-b31a-823e92af27ee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:40.873995 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2a6d60b6-4b1d-4d95-b31a-823e92af27ee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:41.164910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2a6d60b6-4b1d-4d95-b31a-823e92af27ee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:41.175555 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2a6d60b6-4b1d-4d95-b31a-823e92af27ee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:41.177582 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2a6d60b6-4b1d-4d95-b31a-823e92af27ee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:41.178389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2a6d60b6-4b1d-4d95-b31a-823e92af27ee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1747 microversion: 2.20 time: 0.347611 Aug 08 14:33:41.208964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 232/418] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:40 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1747 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:41.363373 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-76cf1f17-5a39-4872-9ec5-e658c491f163 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:41.364091 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-76cf1f17-5a39-4872-9ec5-e658c491f163 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:41.373683 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76cf1f17-5a39-4872-9ec5-e658c491f163 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:41.374537 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76cf1f17-5a39-4872-9ec5-e658c491f163 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:41.375332 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76cf1f17-5a39-4872-9ec5-e658c491f163 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:41.375956 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76cf1f17-5a39-4872-9ec5-e658c491f163 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:41.376413 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76cf1f17-5a39-4872-9ec5-e658c491f163 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:41.376912 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76cf1f17-5a39-4872-9ec5-e658c491f163 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:41.526410 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-76cf1f17-5a39-4872-9ec5-e658c491f163 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:41.534853 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-76cf1f17-5a39-4872-9ec5-e658c491f163 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.176540 Aug 08 14:33:41.535538 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 187/419] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:41 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:41.826060 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-47ff56a9-f74a-4b7c-adaa-f6406fe63492 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:41.826729 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-47ff56a9-f74a-4b7c-adaa-f6406fe63492 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:41.833032 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47ff56a9-f74a-4b7c-adaa-f6406fe63492 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:41.833513 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47ff56a9-f74a-4b7c-adaa-f6406fe63492 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:41.833946 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47ff56a9-f74a-4b7c-adaa-f6406fe63492 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:41.834640 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47ff56a9-f74a-4b7c-adaa-f6406fe63492 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:41.835112 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47ff56a9-f74a-4b7c-adaa-f6406fe63492 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:41.835538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47ff56a9-f74a-4b7c-adaa-f6406fe63492 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:41.850773 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b9967961-6524-4b64-8e3a-63145f0c0f5e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:41.851568 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b9967961-6524-4b64-8e3a-63145f0c0f5e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:41.862043 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b9967961-6524-4b64-8e3a-63145f0c0f5e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:41.866110 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b9967961-6524-4b64-8e3a-63145f0c0f5e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:41.867230 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b9967961-6524-4b64-8e3a-63145f0c0f5e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:41.867883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b9967961-6524-4b64-8e3a-63145f0c0f5e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:41.868376 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b9967961-6524-4b64-8e3a-63145f0c0f5e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:41.868807 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b9967961-6524-4b64-8e3a-63145f0c0f5e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:42.068698 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-47ff56a9-f74a-4b7c-adaa-f6406fe63492 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:42.077561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-47ff56a9-f74a-4b7c-adaa-f6406fe63492 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.254151 Aug 08 14:33:42.090890 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 233/420] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:41 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:42.125196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b9967961-6524-4b64-8e3a-63145f0c0f5e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:42.133258 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b9967961-6524-4b64-8e3a-63145f0c0f5e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1707 microversion: 2.1 time: 0.286714 Aug 08 14:33:42.133824 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 188/421] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:41 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1707 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:42.209239 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3d1c1ca0-d0c0-4bc5-9cb5-3a34d11f2c43 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:42.209844 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3d1c1ca0-d0c0-4bc5-9cb5-3a34d11f2c43 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:42.216236 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3d1c1ca0-d0c0-4bc5-9cb5-3a34d11f2c43 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:42.216714 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3d1c1ca0-d0c0-4bc5-9cb5-3a34d11f2c43 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:42.217145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3d1c1ca0-d0c0-4bc5-9cb5-3a34d11f2c43 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:42.217833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3d1c1ca0-d0c0-4bc5-9cb5-3a34d11f2c43 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:42.218282 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3d1c1ca0-d0c0-4bc5-9cb5-3a34d11f2c43 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:42.218702 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3d1c1ca0-d0c0-4bc5-9cb5-3a34d11f2c43 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:42.458473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3d1c1ca0-d0c0-4bc5-9cb5-3a34d11f2c43 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:42.469584 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3d1c1ca0-d0c0-4bc5-9cb5-3a34d11f2c43 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:42.472117 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3d1c1ca0-d0c0-4bc5-9cb5-3a34d11f2c43 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:42.473785 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3d1c1ca0-d0c0-4bc5-9cb5-3a34d11f2c43 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1749 microversion: 2.20 time: 0.268265 Aug 08 14:33:42.475196 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 234/422] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:42 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1749 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:42.564039 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-64418538-5cc2-4980-82e1-e78ad42840f1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:42.566994 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-64418538-5cc2-4980-82e1-e78ad42840f1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:42.577337 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64418538-5cc2-4980-82e1-e78ad42840f1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:42.578181 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64418538-5cc2-4980-82e1-e78ad42840f1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:42.579127 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64418538-5cc2-4980-82e1-e78ad42840f1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:42.598033 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64418538-5cc2-4980-82e1-e78ad42840f1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:42.598703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64418538-5cc2-4980-82e1-e78ad42840f1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:42.600227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64418538-5cc2-4980-82e1-e78ad42840f1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:42.990826 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-64418538-5cc2-4980-82e1-e78ad42840f1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:42.998936 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-64418538-5cc2-4980-82e1-e78ad42840f1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.445107 Aug 08 14:33:42.999571 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 189/423] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:42 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:43.098656 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-65156aac-cb49-4782-93b9-add9b2cea741 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:43.100013 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-65156aac-cb49-4782-93b9-add9b2cea741 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:43.106844 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65156aac-cb49-4782-93b9-add9b2cea741 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:43.107570 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65156aac-cb49-4782-93b9-add9b2cea741 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:43.108505 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65156aac-cb49-4782-93b9-add9b2cea741 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:43.109655 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65156aac-cb49-4782-93b9-add9b2cea741 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:43.110522 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65156aac-cb49-4782-93b9-add9b2cea741 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:43.111360 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65156aac-cb49-4782-93b9-add9b2cea741 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:43.155304 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3720e6be-cc8c-4c67-b84a-e751c3fc195a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:43.156325 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3720e6be-cc8c-4c67-b84a-e751c3fc195a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:43.164066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3720e6be-cc8c-4c67-b84a-e751c3fc195a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:43.164886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3720e6be-cc8c-4c67-b84a-e751c3fc195a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:43.168103 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3720e6be-cc8c-4c67-b84a-e751c3fc195a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:43.168952 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3720e6be-cc8c-4c67-b84a-e751c3fc195a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:43.169508 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3720e6be-cc8c-4c67-b84a-e751c3fc195a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:43.170028 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3720e6be-cc8c-4c67-b84a-e751c3fc195a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:43.404504 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-65156aac-cb49-4782-93b9-add9b2cea741 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:43.411694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:43.419888 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-65156aac-cb49-4782-93b9-add9b2cea741 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.320613 Aug 08 14:33:43.434482 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 235/424] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:43 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:43.467733 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3720e6be-cc8c-4c67-b84a-e751c3fc195a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:43.484374 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3720e6be-cc8c-4c67-b84a-e751c3fc195a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1711 microversion: 2.1 time: 0.333408 Aug 08 14:33:43.484948 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 190/425] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:43 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1711 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:43.506591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-dcfb7fe4-ab52-4b36-9246-db3d7258184e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:43.508013 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-dcfb7fe4-ab52-4b36-9246-db3d7258184e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:43.524368 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dcfb7fe4-ab52-4b36-9246-db3d7258184e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:43.525030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dcfb7fe4-ab52-4b36-9246-db3d7258184e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:43.525586 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dcfb7fe4-ab52-4b36-9246-db3d7258184e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:43.526474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dcfb7fe4-ab52-4b36-9246-db3d7258184e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:43.527042 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dcfb7fe4-ab52-4b36-9246-db3d7258184e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:43.527622 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dcfb7fe4-ab52-4b36-9246-db3d7258184e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:43.676400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-dcfb7fe4-ab52-4b36-9246-db3d7258184e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:43.687331 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-dcfb7fe4-ab52-4b36-9246-db3d7258184e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:43.689027 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-dcfb7fe4-ab52-4b36-9246-db3d7258184e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:43.690598 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-dcfb7fe4-ab52-4b36-9246-db3d7258184e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.189798 Aug 08 14:33:43.691336 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 236/426] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:43 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:44.022972 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b766a3e8-cafb-48e8-91e9-02ba0f9aa1e6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:44.024670 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b766a3e8-cafb-48e8-91e9-02ba0f9aa1e6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:44.032390 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b766a3e8-cafb-48e8-91e9-02ba0f9aa1e6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:44.032879 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b766a3e8-cafb-48e8-91e9-02ba0f9aa1e6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:44.033326 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b766a3e8-cafb-48e8-91e9-02ba0f9aa1e6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:44.034016 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b766a3e8-cafb-48e8-91e9-02ba0f9aa1e6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:44.034469 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b766a3e8-cafb-48e8-91e9-02ba0f9aa1e6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:44.034889 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b766a3e8-cafb-48e8-91e9-02ba0f9aa1e6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:44.171981 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b766a3e8-cafb-48e8-91e9-02ba0f9aa1e6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:44.180174 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b766a3e8-cafb-48e8-91e9-02ba0f9aa1e6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.162638 Aug 08 14:33:44.181290 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 191/427] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:44 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:44.441898 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-aed985c4-92fa-4597-89d9-6626625460fb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:44.442505 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-aed985c4-92fa-4597-89d9-6626625460fb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:44.450410 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aed985c4-92fa-4597-89d9-6626625460fb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:44.451105 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aed985c4-92fa-4597-89d9-6626625460fb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:44.451550 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aed985c4-92fa-4597-89d9-6626625460fb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:44.452291 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aed985c4-92fa-4597-89d9-6626625460fb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:44.452748 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aed985c4-92fa-4597-89d9-6626625460fb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:44.453175 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aed985c4-92fa-4597-89d9-6626625460fb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:44.614518 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-aed985c4-92fa-4597-89d9-6626625460fb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:44.623746 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-aed985c4-92fa-4597-89d9-6626625460fb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.186316 Aug 08 14:33:44.627508 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 237/428] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:44 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:44.715105 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fb5dcef9-db94-4324-a47e-f9eb04199f77 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:44.715992 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fb5dcef9-db94-4324-a47e-f9eb04199f77 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:44.722672 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fb5dcef9-db94-4324-a47e-f9eb04199f77 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:44.723081 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fb5dcef9-db94-4324-a47e-f9eb04199f77 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:44.723547 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fb5dcef9-db94-4324-a47e-f9eb04199f77 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:44.724252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fb5dcef9-db94-4324-a47e-f9eb04199f77 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:44.724705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fb5dcef9-db94-4324-a47e-f9eb04199f77 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:44.725136 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fb5dcef9-db94-4324-a47e-f9eb04199f77 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:44.976237 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fb5dcef9-db94-4324-a47e-f9eb04199f77 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:44.985983 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fb5dcef9-db94-4324-a47e-f9eb04199f77 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:44.988179 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fb5dcef9-db94-4324-a47e-f9eb04199f77 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:44.989391 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fb5dcef9-db94-4324-a47e-f9eb04199f77 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.279623 Aug 08 14:33:44.989948 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 192/429] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:44 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:45.201585 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d1f6921f-47cc-43b4-ab9b-104c22345990 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:45.202044 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d1f6921f-47cc-43b4-ab9b-104c22345990 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:45.208116 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d1f6921f-47cc-43b4-ab9b-104c22345990 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:45.208657 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d1f6921f-47cc-43b4-ab9b-104c22345990 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:45.209101 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d1f6921f-47cc-43b4-ab9b-104c22345990 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:45.209886 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d1f6921f-47cc-43b4-ab9b-104c22345990 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:45.210382 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d1f6921f-47cc-43b4-ab9b-104c22345990 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:45.210806 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d1f6921f-47cc-43b4-ab9b-104c22345990 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:45.435787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d1f6921f-47cc-43b4-ab9b-104c22345990 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:45.443319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d1f6921f-47cc-43b4-ab9b-104c22345990 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.245814 Aug 08 14:33:45.443931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 238/430] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:45 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:45.645028 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-28aed979-3823-4c65-a8d7-21587f145191 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:45.645639 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-28aed979-3823-4c65-a8d7-21587f145191 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:45.653732 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28aed979-3823-4c65-a8d7-21587f145191 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:45.654232 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28aed979-3823-4c65-a8d7-21587f145191 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:45.654678 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28aed979-3823-4c65-a8d7-21587f145191 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:45.655418 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28aed979-3823-4c65-a8d7-21587f145191 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:45.655864 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28aed979-3823-4c65-a8d7-21587f145191 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:45.656278 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28aed979-3823-4c65-a8d7-21587f145191 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:45.796522 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-28aed979-3823-4c65-a8d7-21587f145191 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:45.805814 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-28aed979-3823-4c65-a8d7-21587f145191 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.164526 Aug 08 14:33:45.806710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 193/431] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:45 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:46.014511 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ade343cf-a6b6-48c8-9992-3733957b49c1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:46.015789 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ade343cf-a6b6-48c8-9992-3733957b49c1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:46.026456 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ade343cf-a6b6-48c8-9992-3733957b49c1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:46.027029 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ade343cf-a6b6-48c8-9992-3733957b49c1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:46.027472 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ade343cf-a6b6-48c8-9992-3733957b49c1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:46.028200 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ade343cf-a6b6-48c8-9992-3733957b49c1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:46.028729 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ade343cf-a6b6-48c8-9992-3733957b49c1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:46.029250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ade343cf-a6b6-48c8-9992-3733957b49c1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:46.349804 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ade343cf-a6b6-48c8-9992-3733957b49c1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:46.358757 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ade343cf-a6b6-48c8-9992-3733957b49c1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:46.360627 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ade343cf-a6b6-48c8-9992-3733957b49c1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:46.362008 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ade343cf-a6b6-48c8-9992-3733957b49c1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.352085 Aug 08 14:33:46.371374 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 239/432] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:46 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:46.464162 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3330ca48-12ca-414e-bb28-19241f293a6b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:46.464767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3330ca48-12ca-414e-bb28-19241f293a6b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:46.471180 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3330ca48-12ca-414e-bb28-19241f293a6b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:46.471673 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3330ca48-12ca-414e-bb28-19241f293a6b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:46.472104 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3330ca48-12ca-414e-bb28-19241f293a6b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:46.472870 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3330ca48-12ca-414e-bb28-19241f293a6b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:46.473343 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3330ca48-12ca-414e-bb28-19241f293a6b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:46.473769 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3330ca48-12ca-414e-bb28-19241f293a6b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:46.635374 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3330ca48-12ca-414e-bb28-19241f293a6b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:46.644238 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3330ca48-12ca-414e-bb28-19241f293a6b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.183916 Aug 08 14:33:46.644813 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 194/433] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:46 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:46.827361 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3d4fbe52-c923-4978-9d78-953d9fb029f2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:46.828231 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3d4fbe52-c923-4978-9d78-953d9fb029f2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:46.834563 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3d4fbe52-c923-4978-9d78-953d9fb029f2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:46.836063 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3d4fbe52-c923-4978-9d78-953d9fb029f2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:46.836656 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3d4fbe52-c923-4978-9d78-953d9fb029f2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:46.837802 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3d4fbe52-c923-4978-9d78-953d9fb029f2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:46.838299 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3d4fbe52-c923-4978-9d78-953d9fb029f2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:46.838721 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3d4fbe52-c923-4978-9d78-953d9fb029f2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:46.895537 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=4 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:47.022913 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3d4fbe52-c923-4978-9d78-953d9fb029f2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:47.032502 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3d4fbe52-c923-4978-9d78-953d9fb029f2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.209566 Aug 08 14:33:47.033102 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 240/434] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:46 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:47.386401 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f1dfde60-7257-4e10-8fdd-04945ea05328 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:47.386991 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f1dfde60-7257-4e10-8fdd-04945ea05328 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:47.393704 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1dfde60-7257-4e10-8fdd-04945ea05328 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:47.394491 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1dfde60-7257-4e10-8fdd-04945ea05328 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:47.395127 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1dfde60-7257-4e10-8fdd-04945ea05328 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:47.395991 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1dfde60-7257-4e10-8fdd-04945ea05328 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:47.396594 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1dfde60-7257-4e10-8fdd-04945ea05328 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:47.397166 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1dfde60-7257-4e10-8fdd-04945ea05328 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:47.548071 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f1dfde60-7257-4e10-8fdd-04945ea05328 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:47.559008 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f1dfde60-7257-4e10-8fdd-04945ea05328 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:47.560762 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f1dfde60-7257-4e10-8fdd-04945ea05328 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:47.562155 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f1dfde60-7257-4e10-8fdd-04945ea05328 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.179725 Aug 08 14:33:47.573894 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 195/435] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:47 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:47.668483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5043250b-3107-45de-aa0a-d7ea506ccfea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:47.669118 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5043250b-3107-45de-aa0a-d7ea506ccfea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:47.674976 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5043250b-3107-45de-aa0a-d7ea506ccfea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:47.675482 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5043250b-3107-45de-aa0a-d7ea506ccfea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:47.675952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5043250b-3107-45de-aa0a-d7ea506ccfea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:47.676639 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5043250b-3107-45de-aa0a-d7ea506ccfea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:47.677088 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5043250b-3107-45de-aa0a-d7ea506ccfea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:47.677512 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5043250b-3107-45de-aa0a-d7ea506ccfea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:47.823403 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5043250b-3107-45de-aa0a-d7ea506ccfea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:47.830808 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5043250b-3107-45de-aa0a-d7ea506ccfea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.166442 Aug 08 14:33:47.831469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 241/436] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:47 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:48.057053 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fc925d4c-8583-4b93-9e9c-8bc33cffa713 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:48.057776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fc925d4c-8583-4b93-9e9c-8bc33cffa713 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:48.066268 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc925d4c-8583-4b93-9e9c-8bc33cffa713 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:48.067026 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc925d4c-8583-4b93-9e9c-8bc33cffa713 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:48.067520 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc925d4c-8583-4b93-9e9c-8bc33cffa713 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:48.068235 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc925d4c-8583-4b93-9e9c-8bc33cffa713 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:48.068696 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc925d4c-8583-4b93-9e9c-8bc33cffa713 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:48.069664 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc925d4c-8583-4b93-9e9c-8bc33cffa713 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:48.137284 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-cea8c094-abb3-4a7b-bff7-d0c745743bc2 req-18276abb-83ff-4c29-b7e4-5100b71803d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c19ca8ed-1d03-4d63-9e99-900018554325", "name": "network-vif-plugged", "status": "completed", "tag": "a6c756df-1afd-4d0a-a280-181227b91c9d"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:48.163668 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-cea8c094-abb3-4a7b-bff7-d0c745743bc2 req-18276abb-83ff-4c29-b7e4-5100b71803d7 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:48.164173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-cea8c094-abb3-4a7b-bff7-d0c745743bc2 req-18276abb-83ff-4c29-b7e4-5100b71803d7 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:48.167808 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-cea8c094-abb3-4a7b-bff7-d0c745743bc2 req-18276abb-83ff-4c29-b7e4-5100b71803d7 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:48.197472 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-cea8c094-abb3-4a7b-bff7-d0c745743bc2 req-18276abb-83ff-4c29-b7e4-5100b71803d7 service nova] Creating event network-vif-plugged:a6c756df-1afd-4d0a-a280-181227b91c9d for instance c19ca8ed-1d03-4d63-9e99-900018554325 on hv-cinder-85200 Aug 08 14:33:48.203194 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-cea8c094-abb3-4a7b-bff7-d0c745743bc2 req-18276abb-83ff-4c29-b7e4-5100b71803d7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070991 Aug 08 14:33:48.204494 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 242/437] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:33:48.249544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fc925d4c-8583-4b93-9e9c-8bc33cffa713 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:48.261475 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fc925d4c-8583-4b93-9e9c-8bc33cffa713 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.208900 Aug 08 14:33:48.262068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 196/438] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:48 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:48.587756 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2878e762-7c89-407a-92e6-8a0a0171d06b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:48.588954 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2878e762-7c89-407a-92e6-8a0a0171d06b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:48.595549 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2878e762-7c89-407a-92e6-8a0a0171d06b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:48.595961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2878e762-7c89-407a-92e6-8a0a0171d06b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:48.596403 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2878e762-7c89-407a-92e6-8a0a0171d06b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:48.597110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2878e762-7c89-407a-92e6-8a0a0171d06b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:48.597572 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2878e762-7c89-407a-92e6-8a0a0171d06b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:48.598000 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2878e762-7c89-407a-92e6-8a0a0171d06b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:48.745589 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2878e762-7c89-407a-92e6-8a0a0171d06b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:48.754865 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2878e762-7c89-407a-92e6-8a0a0171d06b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:48.756494 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2878e762-7c89-407a-92e6-8a0a0171d06b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:48.758221 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2878e762-7c89-407a-92e6-8a0a0171d06b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.175014 Aug 08 14:33:48.758788 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 243/439] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:48 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:48.852902 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e1b4b46e-107f-48f2-8652-683782f0af87 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:48.853527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e1b4b46e-107f-48f2-8652-683782f0af87 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:48.863376 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e1b4b46e-107f-48f2-8652-683782f0af87 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:48.864478 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e1b4b46e-107f-48f2-8652-683782f0af87 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:48.865319 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e1b4b46e-107f-48f2-8652-683782f0af87 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:48.867237 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e1b4b46e-107f-48f2-8652-683782f0af87 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:48.868133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e1b4b46e-107f-48f2-8652-683782f0af87 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:48.868932 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e1b4b46e-107f-48f2-8652-683782f0af87 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:49.014902 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e1b4b46e-107f-48f2-8652-683782f0af87 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:49.024051 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e1b4b46e-107f-48f2-8652-683782f0af87 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.175641 Aug 08 14:33:49.024597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 197/440] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:48 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:49.283877 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9e74fe36-930b-4ab2-81a0-8c2b06b8e07f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:49.284674 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9e74fe36-930b-4ab2-81a0-8c2b06b8e07f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:49.291570 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e74fe36-930b-4ab2-81a0-8c2b06b8e07f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:49.292328 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e74fe36-930b-4ab2-81a0-8c2b06b8e07f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:49.292762 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e74fe36-930b-4ab2-81a0-8c2b06b8e07f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:49.293459 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e74fe36-930b-4ab2-81a0-8c2b06b8e07f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:49.293914 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e74fe36-930b-4ab2-81a0-8c2b06b8e07f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:49.294339 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9e74fe36-930b-4ab2-81a0-8c2b06b8e07f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:49.448762 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9e74fe36-930b-4ab2-81a0-8c2b06b8e07f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:49.456498 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9e74fe36-930b-4ab2-81a0-8c2b06b8e07f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.176429 Aug 08 14:33:49.457060 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 244/441] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:49 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:49.784046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4518e637-7e86-42b0-97ac-78190a7a436e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:49.784554 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4518e637-7e86-42b0-97ac-78190a7a436e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:49.790598 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4518e637-7e86-42b0-97ac-78190a7a436e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:49.791106 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4518e637-7e86-42b0-97ac-78190a7a436e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:49.791548 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4518e637-7e86-42b0-97ac-78190a7a436e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:49.792501 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4518e637-7e86-42b0-97ac-78190a7a436e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:49.792948 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4518e637-7e86-42b0-97ac-78190a7a436e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:49.793367 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4518e637-7e86-42b0-97ac-78190a7a436e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:49.945493 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4518e637-7e86-42b0-97ac-78190a7a436e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:49.954783 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4518e637-7e86-42b0-97ac-78190a7a436e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:49.956353 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4518e637-7e86-42b0-97ac-78190a7a436e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:49.957518 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4518e637-7e86-42b0-97ac-78190a7a436e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.179473 Aug 08 14:33:49.958076 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 198/442] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:49 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:50.045387 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2e56a808-b657-4c49-8f00-c2c5931f28d7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:50.045955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2e56a808-b657-4c49-8f00-c2c5931f28d7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:50.052023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2e56a808-b657-4c49-8f00-c2c5931f28d7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:50.052510 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2e56a808-b657-4c49-8f00-c2c5931f28d7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:50.052945 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2e56a808-b657-4c49-8f00-c2c5931f28d7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:50.054139 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2e56a808-b657-4c49-8f00-c2c5931f28d7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:50.054756 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2e56a808-b657-4c49-8f00-c2c5931f28d7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:50.055240 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2e56a808-b657-4c49-8f00-c2c5931f28d7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:50.197696 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2e56a808-b657-4c49-8f00-c2c5931f28d7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:50.206108 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2e56a808-b657-4c49-8f00-c2c5931f28d7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.164901 Aug 08 14:33:50.206689 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 245/443] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:50 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:50.477914 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d59c52e3-d9e0-41ff-bf75-91b19f14ddbf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:50.478526 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d59c52e3-d9e0-41ff-bf75-91b19f14ddbf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:50.480708 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:50.486724 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d59c52e3-d9e0-41ff-bf75-91b19f14ddbf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:50.487252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d59c52e3-d9e0-41ff-bf75-91b19f14ddbf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:50.487706 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d59c52e3-d9e0-41ff-bf75-91b19f14ddbf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:50.488411 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d59c52e3-d9e0-41ff-bf75-91b19f14ddbf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:50.488866 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d59c52e3-d9e0-41ff-bf75-91b19f14ddbf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:50.489288 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d59c52e3-d9e0-41ff-bf75-91b19f14ddbf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:50.646653 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d59c52e3-d9e0-41ff-bf75-91b19f14ddbf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:50.656076 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d59c52e3-d9e0-41ff-bf75-91b19f14ddbf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.182245 Aug 08 14:33:50.656803 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 199/444] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:50 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:50.934433 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ee61e3d3-97c6-4d2b-8191-dee1902d47ad tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db165b2c-9a61-4a22-b582-d47b0c4f93f2", "device": "/dev/sdb"}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:33:50.937403 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ee61e3d3-97c6-4d2b-8191-dee1902d47ad tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:50.944571 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ee61e3d3-97c6-4d2b-8191-dee1902d47ad tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:50.945060 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ee61e3d3-97c6-4d2b-8191-dee1902d47ad tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:50.955543 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ee61e3d3-97c6-4d2b-8191-dee1902d47ad tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:50.956496 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ee61e3d3-97c6-4d2b-8191-dee1902d47ad tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:50.956983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ee61e3d3-97c6-4d2b-8191-dee1902d47ad tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:50.957445 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ee61e3d3-97c6-4d2b-8191-dee1902d47ad tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:50.981924 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0ae6ad21-ed0c-4b11-916c-f4469a23bc2c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:50.982690 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0ae6ad21-ed0c-4b11-916c-f4469a23bc2c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:50.989807 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0ae6ad21-ed0c-4b11-916c-f4469a23bc2c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:50.990718 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0ae6ad21-ed0c-4b11-916c-f4469a23bc2c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:50.992021 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0ae6ad21-ed0c-4b11-916c-f4469a23bc2c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:50.994149 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0ae6ad21-ed0c-4b11-916c-f4469a23bc2c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:50.994149 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0ae6ad21-ed0c-4b11-916c-f4469a23bc2c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:50.994149 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0ae6ad21-ed0c-4b11-916c-f4469a23bc2c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:51.141563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0ae6ad21-ed0c-4b11-916c-f4469a23bc2c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:51.145313 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=100 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:51.153113 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0ae6ad21-ed0c-4b11-916c-f4469a23bc2c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:51.154652 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0ae6ad21-ed0c-4b11-916c-f4469a23bc2c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:51.155886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0ae6ad21-ed0c-4b11-916c-f4469a23bc2c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.177955 Aug 08 14:33:51.156474 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 200/445] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:50 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:33:51.228424 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-06219002-72b0-4f41-9e88-346073aae558 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:51.229035 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-06219002-72b0-4f41-9e88-346073aae558 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:51.235193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06219002-72b0-4f41-9e88-346073aae558 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:51.235680 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06219002-72b0-4f41-9e88-346073aae558 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:51.236118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06219002-72b0-4f41-9e88-346073aae558 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:51.236809 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06219002-72b0-4f41-9e88-346073aae558 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:51.237263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06219002-72b0-4f41-9e88-346073aae558 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:51.237686 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06219002-72b0-4f41-9e88-346073aae558 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:51.382831 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-06219002-72b0-4f41-9e88-346073aae558 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:51.392296 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-06219002-72b0-4f41-9e88-346073aae558 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.168025 Aug 08 14:33:51.399151 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 201/446] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:51 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:51.679298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bf58aa68-8b38-4da4-aebb-3f4ec9c4cda3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:51.680016 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bf58aa68-8b38-4da4-aebb-3f4ec9c4cda3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:51.686604 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bf58aa68-8b38-4da4-aebb-3f4ec9c4cda3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:51.687124 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bf58aa68-8b38-4da4-aebb-3f4ec9c4cda3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:51.687553 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bf58aa68-8b38-4da4-aebb-3f4ec9c4cda3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:51.688413 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bf58aa68-8b38-4da4-aebb-3f4ec9c4cda3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:51.688888 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bf58aa68-8b38-4da4-aebb-3f4ec9c4cda3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:51.689295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bf58aa68-8b38-4da4-aebb-3f4ec9c4cda3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:51.840169 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bf58aa68-8b38-4da4-aebb-3f4ec9c4cda3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:51.848963 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bf58aa68-8b38-4da4-aebb-3f4ec9c4cda3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.173862 Aug 08 14:33:51.848963 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 202/447] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:51 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:52.179374 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bcb0685a-c86f-4d08-b5db-e55305500f3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:52.180079 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bcb0685a-c86f-4d08-b5db-e55305500f3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:52.186583 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb0685a-c86f-4d08-b5db-e55305500f3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:52.187069 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb0685a-c86f-4d08-b5db-e55305500f3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:52.187541 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb0685a-c86f-4d08-b5db-e55305500f3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:52.188235 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb0685a-c86f-4d08-b5db-e55305500f3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:52.188684 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb0685a-c86f-4d08-b5db-e55305500f3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:52.189103 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb0685a-c86f-4d08-b5db-e55305500f3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:52.342863 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bcb0685a-c86f-4d08-b5db-e55305500f3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:52.352002 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bcb0685a-c86f-4d08-b5db-e55305500f3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:52.353555 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bcb0685a-c86f-4d08-b5db-e55305500f3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:52.354833 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bcb0685a-c86f-4d08-b5db-e55305500f3d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.179439 Aug 08 14:33:52.355445 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 203/448] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:52 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:33:52.415010 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-833c1f9d-cc3c-4263-ab5f-00d134cb3086 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:52.415787 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-833c1f9d-cc3c-4263-ab5f-00d134cb3086 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:52.422469 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-833c1f9d-cc3c-4263-ab5f-00d134cb3086 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:52.422970 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-833c1f9d-cc3c-4263-ab5f-00d134cb3086 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:52.423452 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-833c1f9d-cc3c-4263-ab5f-00d134cb3086 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:52.424170 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-833c1f9d-cc3c-4263-ab5f-00d134cb3086 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:52.424622 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-833c1f9d-cc3c-4263-ab5f-00d134cb3086 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:52.425047 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-833c1f9d-cc3c-4263-ab5f-00d134cb3086 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:52.586272 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-833c1f9d-cc3c-4263-ab5f-00d134cb3086 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:52.594658 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-833c1f9d-cc3c-4263-ab5f-00d134cb3086 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.183965 Aug 08 14:33:52.595623 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 204/449] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:52 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:52.874056 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9a915a45-1b83-413f-ada5-65537efc7fb1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:52.874780 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9a915a45-1b83-413f-ada5-65537efc7fb1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:52.885055 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9a915a45-1b83-413f-ada5-65537efc7fb1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:52.885744 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9a915a45-1b83-413f-ada5-65537efc7fb1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:52.886317 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9a915a45-1b83-413f-ada5-65537efc7fb1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:52.888059 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9a915a45-1b83-413f-ada5-65537efc7fb1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:52.893057 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9a915a45-1b83-413f-ada5-65537efc7fb1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:52.893057 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9a915a45-1b83-413f-ada5-65537efc7fb1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:53.044788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9a915a45-1b83-413f-ada5-65537efc7fb1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:53.052820 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9a915a45-1b83-413f-ada5-65537efc7fb1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.186367 Aug 08 14:33:53.057646 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 205/450] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:52 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:53.380986 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-035a8458-3395-49b1-acec-1ebe04c698fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:53.381960 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-035a8458-3395-49b1-acec-1ebe04c698fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:53.388854 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-035a8458-3395-49b1-acec-1ebe04c698fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:53.389341 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-035a8458-3395-49b1-acec-1ebe04c698fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:53.389884 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-035a8458-3395-49b1-acec-1ebe04c698fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:53.390952 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-035a8458-3395-49b1-acec-1ebe04c698fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:53.391583 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-035a8458-3395-49b1-acec-1ebe04c698fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:53.391999 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-035a8458-3395-49b1-acec-1ebe04c698fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:53.555750 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-035a8458-3395-49b1-acec-1ebe04c698fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:53.565845 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-035a8458-3395-49b1-acec-1ebe04c698fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:53.567404 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-035a8458-3395-49b1-acec-1ebe04c698fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:53.568662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-035a8458-3395-49b1-acec-1ebe04c698fb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.192680 Aug 08 14:33:53.569710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 206/451] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:53 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:33:53.620250 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b426f05b-7893-4873-a8a0-b92b0112df12 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:53.621093 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b426f05b-7893-4873-a8a0-b92b0112df12 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:53.628333 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b426f05b-7893-4873-a8a0-b92b0112df12 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:53.628875 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b426f05b-7893-4873-a8a0-b92b0112df12 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:53.629542 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b426f05b-7893-4873-a8a0-b92b0112df12 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:53.630341 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b426f05b-7893-4873-a8a0-b92b0112df12 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:53.630868 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b426f05b-7893-4873-a8a0-b92b0112df12 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:53.631880 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b426f05b-7893-4873-a8a0-b92b0112df12 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:53.781374 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b426f05b-7893-4873-a8a0-b92b0112df12 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:53.789720 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b426f05b-7893-4873-a8a0-b92b0112df12 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.173944 Aug 08 14:33:53.790287 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 207/452] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:53 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:54.074816 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7e89eb46-ba7a-4ef8-9a04-66b397f7783b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:54.075570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7e89eb46-ba7a-4ef8-9a04-66b397f7783b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:54.081838 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7e89eb46-ba7a-4ef8-9a04-66b397f7783b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:54.082412 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7e89eb46-ba7a-4ef8-9a04-66b397f7783b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:54.082919 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7e89eb46-ba7a-4ef8-9a04-66b397f7783b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:54.083756 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7e89eb46-ba7a-4ef8-9a04-66b397f7783b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:54.084250 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7e89eb46-ba7a-4ef8-9a04-66b397f7783b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:54.085370 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7e89eb46-ba7a-4ef8-9a04-66b397f7783b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:54.238707 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7e89eb46-ba7a-4ef8-9a04-66b397f7783b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:54.246778 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7e89eb46-ba7a-4ef8-9a04-66b397f7783b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.175741 Aug 08 14:33:54.247646 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 208/453] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:54 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:54.594032 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3d226fe3-4dac-45ad-8258-f62c63d17abe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:54.594809 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3d226fe3-4dac-45ad-8258-f62c63d17abe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:54.602480 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3d226fe3-4dac-45ad-8258-f62c63d17abe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:54.602972 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3d226fe3-4dac-45ad-8258-f62c63d17abe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:54.603458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3d226fe3-4dac-45ad-8258-f62c63d17abe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:54.604202 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3d226fe3-4dac-45ad-8258-f62c63d17abe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:54.604660 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3d226fe3-4dac-45ad-8258-f62c63d17abe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:54.605089 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3d226fe3-4dac-45ad-8258-f62c63d17abe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:54.757306 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3d226fe3-4dac-45ad-8258-f62c63d17abe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:54.766094 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3d226fe3-4dac-45ad-8258-f62c63d17abe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:54.767683 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3d226fe3-4dac-45ad-8258-f62c63d17abe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:54.768860 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3d226fe3-4dac-45ad-8258-f62c63d17abe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.179547 Aug 08 14:33:54.777798 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 209/454] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:54 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:33:54.813832 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-dfeb092c-95ba-4268-856f-bbfcc49c4e92 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:54.814442 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-dfeb092c-95ba-4268-856f-bbfcc49c4e92 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:54.820490 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dfeb092c-95ba-4268-856f-bbfcc49c4e92 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:54.820985 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dfeb092c-95ba-4268-856f-bbfcc49c4e92 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:54.821430 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dfeb092c-95ba-4268-856f-bbfcc49c4e92 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:54.822146 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dfeb092c-95ba-4268-856f-bbfcc49c4e92 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:54.822610 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dfeb092c-95ba-4268-856f-bbfcc49c4e92 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:54.823039 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dfeb092c-95ba-4268-856f-bbfcc49c4e92 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:54.978712 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-dfeb092c-95ba-4268-856f-bbfcc49c4e92 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:54.991743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-dfeb092c-95ba-4268-856f-bbfcc49c4e92 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.181003 Aug 08 14:33:54.992618 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 210/455] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:54 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:55.268968 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c64c61a8-a8f4-4702-ba7a-fe3e5b21dd63 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:55.269487 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c64c61a8-a8f4-4702-ba7a-fe3e5b21dd63 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:55.276247 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c64c61a8-a8f4-4702-ba7a-fe3e5b21dd63 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:55.276915 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c64c61a8-a8f4-4702-ba7a-fe3e5b21dd63 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:55.277339 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c64c61a8-a8f4-4702-ba7a-fe3e5b21dd63 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:55.278276 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c64c61a8-a8f4-4702-ba7a-fe3e5b21dd63 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:55.278804 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c64c61a8-a8f4-4702-ba7a-fe3e5b21dd63 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:55.279348 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c64c61a8-a8f4-4702-ba7a-fe3e5b21dd63 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:55.421853 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c64c61a8-a8f4-4702-ba7a-fe3e5b21dd63 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:55.429378 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c64c61a8-a8f4-4702-ba7a-fe3e5b21dd63 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.164382 Aug 08 14:33:55.429953 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 211/456] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:55 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:55.793372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-98f506d9-33d7-4618-a834-642ffd4ecfa1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:55.794262 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-98f506d9-33d7-4618-a834-642ffd4ecfa1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:55.800718 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98f506d9-33d7-4618-a834-642ffd4ecfa1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:55.801215 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98f506d9-33d7-4618-a834-642ffd4ecfa1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:55.801811 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98f506d9-33d7-4618-a834-642ffd4ecfa1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:55.802536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98f506d9-33d7-4618-a834-642ffd4ecfa1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:55.802995 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98f506d9-33d7-4618-a834-642ffd4ecfa1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:55.803520 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98f506d9-33d7-4618-a834-642ffd4ecfa1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:55.948132 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-98f506d9-33d7-4618-a834-642ffd4ecfa1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:55.957281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-98f506d9-33d7-4618-a834-642ffd4ecfa1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:55.958684 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-98f506d9-33d7-4618-a834-642ffd4ecfa1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:55.959980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-98f506d9-33d7-4618-a834-642ffd4ecfa1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.170908 Aug 08 14:33:55.960592 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 212/457] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:55 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:33:56.020642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d666479b-5d32-440a-ae6f-5f264c89f797 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:56.022428 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d666479b-5d32-440a-ae6f-5f264c89f797 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:56.033335 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d666479b-5d32-440a-ae6f-5f264c89f797 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:56.033822 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d666479b-5d32-440a-ae6f-5f264c89f797 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:56.034254 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d666479b-5d32-440a-ae6f-5f264c89f797 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:56.034950 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d666479b-5d32-440a-ae6f-5f264c89f797 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:56.035436 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d666479b-5d32-440a-ae6f-5f264c89f797 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:56.035860 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d666479b-5d32-440a-ae6f-5f264c89f797 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:56.180168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d666479b-5d32-440a-ae6f-5f264c89f797 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:56.187810 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d666479b-5d32-440a-ae6f-5f264c89f797 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.177946 Aug 08 14:33:56.188576 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 213/458] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:56 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:56.450881 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-aaed82b6-465c-4bb8-9bf6-e6573fe03dcf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:56.451428 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-aaed82b6-465c-4bb8-9bf6-e6573fe03dcf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:56.458071 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aaed82b6-465c-4bb8-9bf6-e6573fe03dcf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:56.458567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aaed82b6-465c-4bb8-9bf6-e6573fe03dcf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:56.459006 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aaed82b6-465c-4bb8-9bf6-e6573fe03dcf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:56.459740 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aaed82b6-465c-4bb8-9bf6-e6573fe03dcf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:56.460203 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aaed82b6-465c-4bb8-9bf6-e6573fe03dcf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:56.460624 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aaed82b6-465c-4bb8-9bf6-e6573fe03dcf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:56.660765 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-aaed82b6-465c-4bb8-9bf6-e6573fe03dcf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:56.674706 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-aaed82b6-465c-4bb8-9bf6-e6573fe03dcf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.227304 Aug 08 14:33:56.675667 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 214/459] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:56 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:56.984384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9de911fa-c339-419a-9b1e-6b3d14605aeb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:56.985280 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9de911fa-c339-419a-9b1e-6b3d14605aeb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:56.992066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9de911fa-c339-419a-9b1e-6b3d14605aeb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:56.992558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9de911fa-c339-419a-9b1e-6b3d14605aeb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:56.993029 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9de911fa-c339-419a-9b1e-6b3d14605aeb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:56.993730 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9de911fa-c339-419a-9b1e-6b3d14605aeb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:56.994183 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9de911fa-c339-419a-9b1e-6b3d14605aeb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:56.994604 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9de911fa-c339-419a-9b1e-6b3d14605aeb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:57.140444 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9de911fa-c339-419a-9b1e-6b3d14605aeb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:57.150279 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9de911fa-c339-419a-9b1e-6b3d14605aeb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:57.151921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9de911fa-c339-419a-9b1e-6b3d14605aeb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:57.153293 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9de911fa-c339-419a-9b1e-6b3d14605aeb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.173013 Aug 08 14:33:57.154017 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 215/460] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:56 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:33:57.210805 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-98445ec0-f64f-4c0d-9f29-fff87033db56 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:57.211451 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-98445ec0-f64f-4c0d-9f29-fff87033db56 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:57.217577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98445ec0-f64f-4c0d-9f29-fff87033db56 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:57.218066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98445ec0-f64f-4c0d-9f29-fff87033db56 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:57.218503 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98445ec0-f64f-4c0d-9f29-fff87033db56 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:57.219229 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98445ec0-f64f-4c0d-9f29-fff87033db56 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:57.219702 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98445ec0-f64f-4c0d-9f29-fff87033db56 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:57.220096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98445ec0-f64f-4c0d-9f29-fff87033db56 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:57.350985 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-98445ec0-f64f-4c0d-9f29-fff87033db56 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:57.359057 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-98445ec0-f64f-4c0d-9f29-fff87033db56 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.153485 Aug 08 14:33:57.359700 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 216/461] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:57 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:57.700688 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7aa81a71-90b7-40ce-a21d-4648fa3186d8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:57.701941 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7aa81a71-90b7-40ce-a21d-4648fa3186d8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:57.711510 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7aa81a71-90b7-40ce-a21d-4648fa3186d8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:57.712448 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7aa81a71-90b7-40ce-a21d-4648fa3186d8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:57.713200 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7aa81a71-90b7-40ce-a21d-4648fa3186d8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:57.714186 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7aa81a71-90b7-40ce-a21d-4648fa3186d8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:57.714855 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7aa81a71-90b7-40ce-a21d-4648fa3186d8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:57.715771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7aa81a71-90b7-40ce-a21d-4648fa3186d8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:57.741422 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=100 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:33:57.862103 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7aa81a71-90b7-40ce-a21d-4648fa3186d8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:57.870389 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7aa81a71-90b7-40ce-a21d-4648fa3186d8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.176639 Aug 08 14:33:57.870961 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 217/462] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:57 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:58.180245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4d9f0e4a-6bb7-4ef0-8d56-b3dd3ccd34f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:58.180909 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4d9f0e4a-6bb7-4ef0-8d56-b3dd3ccd34f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:58.187265 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d9f0e4a-6bb7-4ef0-8d56-b3dd3ccd34f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:58.187748 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d9f0e4a-6bb7-4ef0-8d56-b3dd3ccd34f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:58.188187 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d9f0e4a-6bb7-4ef0-8d56-b3dd3ccd34f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:58.188869 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d9f0e4a-6bb7-4ef0-8d56-b3dd3ccd34f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:58.189323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d9f0e4a-6bb7-4ef0-8d56-b3dd3ccd34f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:58.189744 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d9f0e4a-6bb7-4ef0-8d56-b3dd3ccd34f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:58.323440 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4d9f0e4a-6bb7-4ef0-8d56-b3dd3ccd34f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:58.331800 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4d9f0e4a-6bb7-4ef0-8d56-b3dd3ccd34f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:58.333334 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4d9f0e4a-6bb7-4ef0-8d56-b3dd3ccd34f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:58.334529 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4d9f0e4a-6bb7-4ef0-8d56-b3dd3ccd34f9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.158839 Aug 08 14:33:58.335156 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 218/463] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:58 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:33:58.381057 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-debfee16-6c18-48b1-9f16-76ce398bfb5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:58.382493 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-debfee16-6c18-48b1-9f16-76ce398bfb5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:58.388480 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-debfee16-6c18-48b1-9f16-76ce398bfb5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:58.388964 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-debfee16-6c18-48b1-9f16-76ce398bfb5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:58.389398 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-debfee16-6c18-48b1-9f16-76ce398bfb5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:58.390118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-debfee16-6c18-48b1-9f16-76ce398bfb5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:58.390631 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-debfee16-6c18-48b1-9f16-76ce398bfb5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:58.391055 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-debfee16-6c18-48b1-9f16-76ce398bfb5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:58.530733 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-debfee16-6c18-48b1-9f16-76ce398bfb5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:58.538666 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-debfee16-6c18-48b1-9f16-76ce398bfb5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.161736 Aug 08 14:33:58.539426 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 219/464] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:58 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:33:58.891273 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3db51a6c-b494-461f-82af-9fe616765668 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:58.892204 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3db51a6c-b494-461f-82af-9fe616765668 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:58.900131 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ee61e3d3-97c6-4d2b-8191-dee1902d47ad tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "POST /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.969508 Aug 08 14:33:58.900878 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 246/465] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 14:33:50 2022] POST /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668/os-volume_attachments => generated 194 bytes in 7971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:33:58.906455 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3db51a6c-b494-461f-82af-9fe616765668 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:58.907062 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3db51a6c-b494-461f-82af-9fe616765668 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:58.907564 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3db51a6c-b494-461f-82af-9fe616765668 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:58.908281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3db51a6c-b494-461f-82af-9fe616765668 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:58.908737 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3db51a6c-b494-461f-82af-9fe616765668 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:58.909160 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3db51a6c-b494-461f-82af-9fe616765668 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:59.097285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3db51a6c-b494-461f-82af-9fe616765668 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:59.105588 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3db51a6c-b494-461f-82af-9fe616765668 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.218831 Aug 08 14:33:59.106192 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 220/466] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:58 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:33:59.358714 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e4142df0-2ea2-407e-ba4e-d963cf7a58de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:59.360981 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e4142df0-2ea2-407e-ba4e-d963cf7a58de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:59.369016 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4142df0-2ea2-407e-ba4e-d963cf7a58de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:59.369790 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4142df0-2ea2-407e-ba4e-d963cf7a58de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:59.370466 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4142df0-2ea2-407e-ba4e-d963cf7a58de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:59.371440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4142df0-2ea2-407e-ba4e-d963cf7a58de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:59.372135 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4142df0-2ea2-407e-ba4e-d963cf7a58de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:59.372793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4142df0-2ea2-407e-ba4e-d963cf7a58de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:59.508530 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e4142df0-2ea2-407e-ba4e-d963cf7a58de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:59.517092 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e4142df0-2ea2-407e-ba4e-d963cf7a58de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:59.518633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e4142df0-2ea2-407e-ba4e-d963cf7a58de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:59.519924 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e4142df0-2ea2-407e-ba4e-d963cf7a58de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.166051 Aug 08 14:33:59.520480 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 247/467] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:33:59 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:33:59.560371 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b15ef7b6-f22f-4bd1-bc34-9192b362f7dc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:33:59.560968 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b15ef7b6-f22f-4bd1-bc34-9192b362f7dc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:33:59.567388 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b15ef7b6-f22f-4bd1-bc34-9192b362f7dc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:59.567811 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b15ef7b6-f22f-4bd1-bc34-9192b362f7dc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:59.568242 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b15ef7b6-f22f-4bd1-bc34-9192b362f7dc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:59.569437 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b15ef7b6-f22f-4bd1-bc34-9192b362f7dc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:33:59.569879 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b15ef7b6-f22f-4bd1-bc34-9192b362f7dc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:33:59.570299 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b15ef7b6-f22f-4bd1-bc34-9192b362f7dc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:33:59.705123 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b15ef7b6-f22f-4bd1-bc34-9192b362f7dc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:33:59.712742 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b15ef7b6-f22f-4bd1-bc34-9192b362f7dc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.156117 Aug 08 14:33:59.713300 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 221/468] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:33:59 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:00.125927 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ec13a24b-2991-405f-a268-f3de53c3d1c6 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:00.126530 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ec13a24b-2991-405f-a268-f3de53c3d1c6 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:00.133805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ec13a24b-2991-405f-a268-f3de53c3d1c6 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:00.134826 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ec13a24b-2991-405f-a268-f3de53c3d1c6 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:00.135292 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ec13a24b-2991-405f-a268-f3de53c3d1c6 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:00.136529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ec13a24b-2991-405f-a268-f3de53c3d1c6 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:00.136979 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ec13a24b-2991-405f-a268-f3de53c3d1c6 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:00.137685 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ec13a24b-2991-405f-a268-f3de53c3d1c6 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:00.275047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ec13a24b-2991-405f-a268-f3de53c3d1c6 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:00.282791 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ec13a24b-2991-405f-a268-f3de53c3d1c6 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.160852 Aug 08 14:34:00.283403 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 248/469] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:00 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:00.544419 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8cd0bd37-f083-469b-8749-eecadfadc22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:00.545032 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8cd0bd37-f083-469b-8749-eecadfadc22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:00.553888 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8cd0bd37-f083-469b-8749-eecadfadc22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:00.554567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8cd0bd37-f083-469b-8749-eecadfadc22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:00.555502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8cd0bd37-f083-469b-8749-eecadfadc22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:00.556337 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8cd0bd37-f083-469b-8749-eecadfadc22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:00.557027 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8cd0bd37-f083-469b-8749-eecadfadc22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:00.557744 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8cd0bd37-f083-469b-8749-eecadfadc22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:00.732950 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9f520671-6b12-4f35-b2d5-17a55f3add21 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:00.734420 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9f520671-6b12-4f35-b2d5-17a55f3add21 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:00.741772 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9f520671-6b12-4f35-b2d5-17a55f3add21 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:00.742290 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9f520671-6b12-4f35-b2d5-17a55f3add21 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:00.742979 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9f520671-6b12-4f35-b2d5-17a55f3add21 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:00.743975 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9f520671-6b12-4f35-b2d5-17a55f3add21 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:00.744596 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9f520671-6b12-4f35-b2d5-17a55f3add21 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:00.745064 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9f520671-6b12-4f35-b2d5-17a55f3add21 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:00.766509 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8cd0bd37-f083-469b-8749-eecadfadc22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:00.776538 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8cd0bd37-f083-469b-8749-eecadfadc22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:00.778244 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8cd0bd37-f083-469b-8749-eecadfadc22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:00.779527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8cd0bd37-f083-469b-8749-eecadfadc22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.239051 Aug 08 14:34:00.779954 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 222/470] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:00 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:00.898077 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9f520671-6b12-4f35-b2d5-17a55f3add21 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:00.905535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9f520671-6b12-4f35-b2d5-17a55f3add21 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.176627 Aug 08 14:34:00.906028 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 249/471] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:00 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:01.304252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bcb81813-3f61-49db-ad1e-b13c3fd14ef8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:01.304774 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bcb81813-3f61-49db-ad1e-b13c3fd14ef8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:01.310786 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb81813-3f61-49db-ad1e-b13c3fd14ef8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:01.311315 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb81813-3f61-49db-ad1e-b13c3fd14ef8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:01.311758 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb81813-3f61-49db-ad1e-b13c3fd14ef8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:01.312508 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb81813-3f61-49db-ad1e-b13c3fd14ef8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:01.312964 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb81813-3f61-49db-ad1e-b13c3fd14ef8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:01.313391 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bcb81813-3f61-49db-ad1e-b13c3fd14ef8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:01.451220 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bcb81813-3f61-49db-ad1e-b13c3fd14ef8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:01.458501 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bcb81813-3f61-49db-ad1e-b13c3fd14ef8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.158286 Aug 08 14:34:01.459060 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 223/472] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:01 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:01.803837 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9807df9a-233c-47bb-aaf1-cbe37535d530 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:01.804547 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9807df9a-233c-47bb-aaf1-cbe37535d530 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:01.811229 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9807df9a-233c-47bb-aaf1-cbe37535d530 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:01.811721 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9807df9a-233c-47bb-aaf1-cbe37535d530 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:01.812164 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9807df9a-233c-47bb-aaf1-cbe37535d530 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:01.812888 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9807df9a-233c-47bb-aaf1-cbe37535d530 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:01.813332 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9807df9a-233c-47bb-aaf1-cbe37535d530 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:01.813756 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9807df9a-233c-47bb-aaf1-cbe37535d530 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:01.927337 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-48af3bcb-48c9-4ceb-9ac4-fdf9f0768f82 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:01.928438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-48af3bcb-48c9-4ceb-9ac4-fdf9f0768f82 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:01.934855 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-48af3bcb-48c9-4ceb-9ac4-fdf9f0768f82 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:01.935379 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-48af3bcb-48c9-4ceb-9ac4-fdf9f0768f82 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:01.935833 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-48af3bcb-48c9-4ceb-9ac4-fdf9f0768f82 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:01.936536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-48af3bcb-48c9-4ceb-9ac4-fdf9f0768f82 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:01.937312 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-48af3bcb-48c9-4ceb-9ac4-fdf9f0768f82 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:01.937745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-48af3bcb-48c9-4ceb-9ac4-fdf9f0768f82 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:01.949807 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9807df9a-233c-47bb-aaf1-cbe37535d530 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:01.959051 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9807df9a-233c-47bb-aaf1-cbe37535d530 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:01.960755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9807df9a-233c-47bb-aaf1-cbe37535d530 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:01.961922 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9807df9a-233c-47bb-aaf1-cbe37535d530 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.162076 Aug 08 14:34:01.963310 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 250/473] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:01 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:02.070094 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-48af3bcb-48c9-4ceb-9ac4-fdf9f0768f82 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:02.077433 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-48af3bcb-48c9-4ceb-9ac4-fdf9f0768f82 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.154150 Aug 08 14:34:02.077996 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 224/474] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:01 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:02.480160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ba7e162c-0dd3-4b52-9661-b9617fac5f69 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:02.480812 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ba7e162c-0dd3-4b52-9661-b9617fac5f69 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:02.487229 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba7e162c-0dd3-4b52-9661-b9617fac5f69 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:02.487720 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba7e162c-0dd3-4b52-9661-b9617fac5f69 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:02.488162 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba7e162c-0dd3-4b52-9661-b9617fac5f69 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:02.488861 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba7e162c-0dd3-4b52-9661-b9617fac5f69 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:02.489842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba7e162c-0dd3-4b52-9661-b9617fac5f69 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:02.489842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba7e162c-0dd3-4b52-9661-b9617fac5f69 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:02.643247 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ba7e162c-0dd3-4b52-9661-b9617fac5f69 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:02.647278 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:02.652437 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ba7e162c-0dd3-4b52-9661-b9617fac5f69 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1367 microversion: 2.1 time: 0.176239 Aug 08 14:34:02.652998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 251/475] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:02 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:02.896377 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1051917816", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1152802890", "security_groups": [{"name": "tempest-secgroup-smoke-736139520"}], "networks": [{"uuid": "21237ba1-d91c-4bcc-8eeb-bc48f48f495e"}], "block_device_mapping_v2": [{"uuid": "57432eef-4907-48e7-974d-7d9eb5e6cc43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:02.986177 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f10d19f9-e0b0-4d35-8739-e44ee5ef7bfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:02.986787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f10d19f9-e0b0-4d35-8739-e44ee5ef7bfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:02.994540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f10d19f9-e0b0-4d35-8739-e44ee5ef7bfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:02.995013 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f10d19f9-e0b0-4d35-8739-e44ee5ef7bfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:02.995483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f10d19f9-e0b0-4d35-8739-e44ee5ef7bfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:02.996189 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f10d19f9-e0b0-4d35-8739-e44ee5ef7bfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:02.996638 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f10d19f9-e0b0-4d35-8739-e44ee5ef7bfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:02.997063 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f10d19f9-e0b0-4d35-8739-e44ee5ef7bfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:03.024718 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] validate_networks() for [('21237ba1-d91c-4bcc-8eeb-bc48f48f495e', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:34:03.220814 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f10d19f9-e0b0-4d35-8739-e44ee5ef7bfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:03.231964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f10d19f9-e0b0-4d35-8739-e44ee5ef7bfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:03.234017 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f10d19f9-e0b0-4d35-8739-e44ee5ef7bfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:03.235360 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f10d19f9-e0b0-4d35-8739-e44ee5ef7bfc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.253285 Aug 08 14:34:03.236512 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 252/476] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:02 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:34:03.241673 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-02ff7f07-1661-403c-9f7f-18f548e7c1c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:03.243718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-02ff7f07-1661-403c-9f7f-18f548e7c1c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:03.250023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-02ff7f07-1661-403c-9f7f-18f548e7c1c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:03.250506 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-02ff7f07-1661-403c-9f7f-18f548e7c1c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:03.252110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-02ff7f07-1661-403c-9f7f-18f548e7c1c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:03.252844 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-02ff7f07-1661-403c-9f7f-18f548e7c1c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:03.254459 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-02ff7f07-1661-403c-9f7f-18f548e7c1c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:03.259461 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-02ff7f07-1661-403c-9f7f-18f548e7c1c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:03.471574 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-02ff7f07-1661-403c-9f7f-18f548e7c1c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:03.479830 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-02ff7f07-1661-403c-9f7f-18f548e7c1c7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.242126 Aug 08 14:34:03.480416 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 253/477] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:03 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:03.572188 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:34:03.572647 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:34:03.573117 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:34:03.573522 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:34:03.573927 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:34:03.582618 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:03.583112 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:03.583550 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:03.584328 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:03.584782 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:03.585206 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:03.601410 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Getting quotas for project fb0c0d2823dd4a3fb35bb8c0cad4f410. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:34:03.605251 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Getting quotas for user c376f5bd19c840b7924093606dee6f4f and project fb0c0d2823dd4a3fb35bb8c0cad4f410. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:34:03.667537 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:34:03.669645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57432eef-4907-48e7-974d-7d9eb5e6cc43',volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:34:03.673036 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-733d6da4-e370-4d04-be79-d7428e04a9d5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:03.673777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-733d6da4-e370-4d04-be79-d7428e04a9d5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:03.680990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-733d6da4-e370-4d04-be79-d7428e04a9d5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:03.681473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-733d6da4-e370-4d04-be79-d7428e04a9d5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:03.681906 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-733d6da4-e370-4d04-be79-d7428e04a9d5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:03.682601 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-733d6da4-e370-4d04-be79-d7428e04a9d5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:03.683050 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-733d6da4-e370-4d04-be79-d7428e04a9d5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:03.683543 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-733d6da4-e370-4d04-be79-d7428e04a9d5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:03.810308 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c04e0310-d90f-491a-b7f3-2b2ab651843d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.917826 Aug 08 14:34:03.810949 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 225/478] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:34:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:34:03.822953 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a8c85e8a-2473-4494-849f-ca9aa32ba64b tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:03.823674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a8c85e8a-2473-4494-849f-ca9aa32ba64b tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:03.837649 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-733d6da4-e370-4d04-be79-d7428e04a9d5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:03.847035 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-733d6da4-e370-4d04-be79-d7428e04a9d5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1556 microversion: 2.1 time: 0.177854 Aug 08 14:34:03.847842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 254/479] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:03 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:03.869745 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3087fcb0-36a2-40d7-bea9-5dcdc97b4ba3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:03.870263 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3087fcb0-36a2-40d7-bea9-5dcdc97b4ba3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:03.876908 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3087fcb0-36a2-40d7-bea9-5dcdc97b4ba3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:03.877406 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3087fcb0-36a2-40d7-bea9-5dcdc97b4ba3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:03.877891 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3087fcb0-36a2-40d7-bea9-5dcdc97b4ba3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:03.878615 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3087fcb0-36a2-40d7-bea9-5dcdc97b4ba3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:03.879080 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3087fcb0-36a2-40d7-bea9-5dcdc97b4ba3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:03.879597 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3087fcb0-36a2-40d7-bea9-5dcdc97b4ba3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:03.885782 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a8c85e8a-2473-4494-849f-ca9aa32ba64b tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:03.893266 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a8c85e8a-2473-4494-849f-ca9aa32ba64b tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1089 microversion: 2.1 time: 0.075130 Aug 08 14:34:03.894236 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 226/480] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:03 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:03.968649 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3087fcb0-36a2-40d7-bea9-5dcdc97b4ba3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104142 Aug 08 14:34:03.969407 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 255/481] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 14:34:03 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:34:04.259831 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1ef252b2-eab2-46a2-8d2d-06514583dbdb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:04.261080 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1ef252b2-eab2-46a2-8d2d-06514583dbdb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:04.271018 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ef252b2-eab2-46a2-8d2d-06514583dbdb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:04.272296 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ef252b2-eab2-46a2-8d2d-06514583dbdb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:04.272788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ef252b2-eab2-46a2-8d2d-06514583dbdb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:04.273997 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ef252b2-eab2-46a2-8d2d-06514583dbdb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:04.274591 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ef252b2-eab2-46a2-8d2d-06514583dbdb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:04.275039 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ef252b2-eab2-46a2-8d2d-06514583dbdb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:04.450267 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1ef252b2-eab2-46a2-8d2d-06514583dbdb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:04.458732 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1ef252b2-eab2-46a2-8d2d-06514583dbdb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:04.460784 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1ef252b2-eab2-46a2-8d2d-06514583dbdb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:04.461946 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1ef252b2-eab2-46a2-8d2d-06514583dbdb tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.207588 Aug 08 14:34:04.462503 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 227/482] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:04 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:04.501840 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-df384486-ace6-4f3a-ae1f-143162975590 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:04.502455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-df384486-ace6-4f3a-ae1f-143162975590 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:04.509588 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-df384486-ace6-4f3a-ae1f-143162975590 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:04.510085 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-df384486-ace6-4f3a-ae1f-143162975590 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:04.510532 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-df384486-ace6-4f3a-ae1f-143162975590 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:04.513151 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-df384486-ace6-4f3a-ae1f-143162975590 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:04.513631 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-df384486-ace6-4f3a-ae1f-143162975590 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:04.514065 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-df384486-ace6-4f3a-ae1f-143162975590 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:04.674766 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-df384486-ace6-4f3a-ae1f-143162975590 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:04.682731 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-df384486-ace6-4f3a-ae1f-143162975590 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1502 microversion: 2.1 time: 0.185164 Aug 08 14:34:04.683422 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 256/483] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:04 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:04.706653 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8ee33162-53b7-4d60-8d42-5414c6b016d6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c09acd4-ef78-44d8-ad3c-f82c668a5793"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:04.710053 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8ee33162-53b7-4d60-8d42-5414c6b016d6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:04.716060 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8ee33162-53b7-4d60-8d42-5414c6b016d6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:04.716551 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8ee33162-53b7-4d60-8d42-5414c6b016d6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:04.716990 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8ee33162-53b7-4d60-8d42-5414c6b016d6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:04.717699 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8ee33162-53b7-4d60-8d42-5414c6b016d6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:04.718158 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8ee33162-53b7-4d60-8d42-5414c6b016d6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:04.718697 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8ee33162-53b7-4d60-8d42-5414c6b016d6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:04.742214 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-8ee33162-53b7-4d60-8d42-5414c6b016d6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] HTTP exception thrown: Cannot 'attach_volume' instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 while it is in vm_state rescued Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8ee33162-53b7-4d60-8d42-5414c6b016d6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Request method failure captured: Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: POST /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9/os-volume_attachments HTTP/1.1 Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 74 Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R57J81LntT0wnBLoq0gsHuTcdb_gHa2boWqNwcHJNT7GzMY0xQaN4u9gbPeQMkc14SBA7jeP_d07iW79RHlaNziPk2GWGa1BYt-GMeY3VrGnZvm8TtxiX0dmqfpjGqGooMq0e11KFxasfjzOL609Nmftln0YBM8XLy3f2h8GasueEo Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 6ecb83fbcae94dca82331ab87f028878 Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:34:04.744193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:34:04.745728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6ecb83fbcae94dca82331ab87f028878"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6ecb83fbcae94dca82331ab87f028878", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ecb83fbcae94dca82331ab87f028878"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ecb83fbcae94dca82331ab87f028878"}]}] Aug 08 14:34:04.745728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:34:04.745728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 6ecb83fbcae94dca82331ab87f028878 Aug 08 14:34:04.745728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:34:04.745728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-ServerRescueNegativeTestJSON-1730375856-project Aug 08 14:34:04.745728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:34:04.745728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:34:04.745728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 7d373dfa8c474ade92e94dc73dd9926f Aug 08 14:34:04.745728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1730375856-project Aug 08 14:34:04.745728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Aug 08 14:34:04.745728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {"volumeAttachment": {"volumeId": "0c09acd4-ef78-44d8-ad3c-f82c668a5793"}} Aug 08 14:34:04.745728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Cannot 'attach_volume' instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 while it is in vm_state rescued Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'server_id': 'e9f83a0c-1b6f-446f-96d5-804d508e2cf9', 'body': {'volumeAttachment': {'volumeId': '0c09acd4-ef78-44d8-ad3c-f82c668a5793'}}} Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:34:04.746629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 while it is in vm_state rescued Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:34:04.747802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:34:04.748883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:34:04.748883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:34:04.748883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 while it is in vm_state rescued Aug 08 14:34:04.748883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:34:04.748883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8ee33162-53b7-4d60-8d42-5414c6b016d6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Returning 409 to user: Cannot 'attach_volume' instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 while it is in vm_state rescued {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:34:04.748883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8ee33162-53b7-4d60-8d42-5414c6b016d6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "POST /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043231 Aug 08 14:34:04.748883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 228/484] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 14:34:04 2022] POST /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 08 14:34:04.756782 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4082d6aa-6efc-46c8-b1e5-304a9f91d618 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:04.757323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-4082d6aa-6efc-46c8-b1e5-304a9f91d618 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:04.763743 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4082d6aa-6efc-46c8-b1e5-304a9f91d618 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:04.764155 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4082d6aa-6efc-46c8-b1e5-304a9f91d618 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:04.764594 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4082d6aa-6efc-46c8-b1e5-304a9f91d618 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:04.765313 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4082d6aa-6efc-46c8-b1e5-304a9f91d618 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:04.765765 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4082d6aa-6efc-46c8-b1e5-304a9f91d618 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:04.766189 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4082d6aa-6efc-46c8-b1e5-304a9f91d618 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:04.837921 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-4082d6aa-6efc-46c8-b1e5-304a9f91d618 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "POST /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9/action" status: 202 len: 0 microversion: 2.1 time: 0.086915 Aug 08 14:34:04.838764 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 257/485] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 14:34:04 2022] POST /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 14:34:04.847148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f35a0b41-218a-47fd-b887-9fa0ba7c29e5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:04.848000 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f35a0b41-218a-47fd-b887-9fa0ba7c29e5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:04.854037 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f35a0b41-218a-47fd-b887-9fa0ba7c29e5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:04.854530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f35a0b41-218a-47fd-b887-9fa0ba7c29e5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:04.854968 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f35a0b41-218a-47fd-b887-9fa0ba7c29e5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:04.855704 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f35a0b41-218a-47fd-b887-9fa0ba7c29e5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:04.856169 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f35a0b41-218a-47fd-b887-9fa0ba7c29e5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:04.856621 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f35a0b41-218a-47fd-b887-9fa0ba7c29e5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:04.915116 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-dba1ed13-c345-43af-8d89-28c0b6b072ad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:04.915948 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-dba1ed13-c345-43af-8d89-28c0b6b072ad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:04.923894 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dba1ed13-c345-43af-8d89-28c0b6b072ad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:04.924494 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dba1ed13-c345-43af-8d89-28c0b6b072ad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:04.925014 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dba1ed13-c345-43af-8d89-28c0b6b072ad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:04.925826 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dba1ed13-c345-43af-8d89-28c0b6b072ad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:04.926374 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dba1ed13-c345-43af-8d89-28c0b6b072ad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:04.926883 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dba1ed13-c345-43af-8d89-28c0b6b072ad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:05.024592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-dba1ed13-c345-43af-8d89-28c0b6b072ad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:05.034816 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-dba1ed13-c345-43af-8d89-28c0b6b072ad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1139 microversion: 2.1 time: 0.123793 Aug 08 14:34:05.047132 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 258/486] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:04 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1139 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:05.055846 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f35a0b41-218a-47fd-b887-9fa0ba7c29e5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:05.064277 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-13dcee46-4751-42cc-a9b0-557fbc28bb4d req-f171de1f-fe60-4867-8d2f-f518366d85e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c19ca8ed-1d03-4d63-9e99-900018554325", "tag": "a6c756df-1afd-4d0a-a280-181227b91c9d"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:05.064843 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f35a0b41-218a-47fd-b887-9fa0ba7c29e5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1510 microversion: 2.1 time: 0.221366 Aug 08 14:34:05.065881 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 229/487] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:04 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:05.085935 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-13dcee46-4751-42cc-a9b0-557fbc28bb4d req-f171de1f-fe60-4867-8d2f-f518366d85e9 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:05.086405 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-13dcee46-4751-42cc-a9b0-557fbc28bb4d req-f171de1f-fe60-4867-8d2f-f518366d85e9 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:05.086835 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-13dcee46-4751-42cc-a9b0-557fbc28bb4d req-f171de1f-fe60-4867-8d2f-f518366d85e9 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:05.097972 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-13dcee46-4751-42cc-a9b0-557fbc28bb4d req-f171de1f-fe60-4867-8d2f-f518366d85e9 service nova] Creating event network-changed:a6c756df-1afd-4d0a-a280-181227b91c9d for instance c19ca8ed-1d03-4d63-9e99-900018554325 on hv-cinder-85200 Aug 08 14:34:05.103494 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-13dcee46-4751-42cc-a9b0-557fbc28bb4d req-f171de1f-fe60-4867-8d2f-f518366d85e9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043265 Aug 08 14:34:05.104308 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 259/488] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:34:05.485105 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-10f96397-14c9-447e-b191-e95839c6e063 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:05.485710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-10f96397-14c9-447e-b191-e95839c6e063 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:05.492697 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-10f96397-14c9-447e-b191-e95839c6e063 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:05.493186 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-10f96397-14c9-447e-b191-e95839c6e063 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:05.493619 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-10f96397-14c9-447e-b191-e95839c6e063 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:05.494322 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-10f96397-14c9-447e-b191-e95839c6e063 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:05.494784 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-10f96397-14c9-447e-b191-e95839c6e063 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:05.495225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-10f96397-14c9-447e-b191-e95839c6e063 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:05.632427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-10f96397-14c9-447e-b191-e95839c6e063 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:05.642013 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-10f96397-14c9-447e-b191-e95839c6e063 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:05.643560 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-10f96397-14c9-447e-b191-e95839c6e063 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:05.644716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-10f96397-14c9-447e-b191-e95839c6e063 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.163573 Aug 08 14:34:05.645270 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 230/489] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:05 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:06.062346 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c6f76c9f-51df-42a6-9caa-6495ae09b77c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:06.063153 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c6f76c9f-51df-42a6-9caa-6495ae09b77c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:06.071424 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6f76c9f-51df-42a6-9caa-6495ae09b77c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:06.071915 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6f76c9f-51df-42a6-9caa-6495ae09b77c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:06.072353 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6f76c9f-51df-42a6-9caa-6495ae09b77c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:06.073100 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6f76c9f-51df-42a6-9caa-6495ae09b77c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:06.073555 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6f76c9f-51df-42a6-9caa-6495ae09b77c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:06.073976 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6f76c9f-51df-42a6-9caa-6495ae09b77c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:06.087076 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fe03d375-f75a-45dc-a7b0-5e00ac6b070c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:06.087723 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fe03d375-f75a-45dc-a7b0-5e00ac6b070c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:06.093857 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fe03d375-f75a-45dc-a7b0-5e00ac6b070c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:06.094438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fe03d375-f75a-45dc-a7b0-5e00ac6b070c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:06.094949 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fe03d375-f75a-45dc-a7b0-5e00ac6b070c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:06.095794 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fe03d375-f75a-45dc-a7b0-5e00ac6b070c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:06.096357 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fe03d375-f75a-45dc-a7b0-5e00ac6b070c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:06.096888 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fe03d375-f75a-45dc-a7b0-5e00ac6b070c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:06.155628 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c6f76c9f-51df-42a6-9caa-6495ae09b77c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:06.164965 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c6f76c9f-51df-42a6-9caa-6495ae09b77c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1139 microversion: 2.1 time: 0.108634 Aug 08 14:34:06.165856 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 260/490] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:06 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1139 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:06.244400 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fe03d375-f75a-45dc-a7b0-5e00ac6b070c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:06.252568 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fe03d375-f75a-45dc-a7b0-5e00ac6b070c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1510 microversion: 2.1 time: 0.169471 Aug 08 14:34:06.253348 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 231/491] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:06 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:06.668807 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-009623b6-a690-4a2c-9a73-734526ce7ec9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:06.669338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-009623b6-a690-4a2c-9a73-734526ce7ec9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:06.675296 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-009623b6-a690-4a2c-9a73-734526ce7ec9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:06.675789 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-009623b6-a690-4a2c-9a73-734526ce7ec9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:06.676228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-009623b6-a690-4a2c-9a73-734526ce7ec9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:06.676927 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-009623b6-a690-4a2c-9a73-734526ce7ec9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:06.677408 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-009623b6-a690-4a2c-9a73-734526ce7ec9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:06.677815 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-009623b6-a690-4a2c-9a73-734526ce7ec9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:06.810256 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-009623b6-a690-4a2c-9a73-734526ce7ec9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:06.819177 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-009623b6-a690-4a2c-9a73-734526ce7ec9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:06.820878 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-009623b6-a690-4a2c-9a73-734526ce7ec9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:06.822067 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-009623b6-a690-4a2c-9a73-734526ce7ec9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.157624 Aug 08 14:34:06.822634 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 261/492] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:06 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:07.186553 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-65e81967-518a-4314-a2a9-3c4f8c7a37f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:07.187263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-65e81967-518a-4314-a2a9-3c4f8c7a37f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:07.194327 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-65e81967-518a-4314-a2a9-3c4f8c7a37f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:07.194818 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-65e81967-518a-4314-a2a9-3c4f8c7a37f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:07.195260 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-65e81967-518a-4314-a2a9-3c4f8c7a37f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:07.196184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-65e81967-518a-4314-a2a9-3c4f8c7a37f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:07.196588 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-65e81967-518a-4314-a2a9-3c4f8c7a37f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:07.197007 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-65e81967-518a-4314-a2a9-3c4f8c7a37f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:07.258340 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-65e81967-518a-4314-a2a9-3c4f8c7a37f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:07.265688 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-65e81967-518a-4314-a2a9-3c4f8c7a37f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1187 microversion: 2.1 time: 0.083522 Aug 08 14:34:07.266244 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 232/493] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:07 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:07.276229 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e7f3a650-b1ae-4c4c-882b-387c33b5c88e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:07.276965 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e7f3a650-b1ae-4c4c-882b-387c33b5c88e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:07.283538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7f3a650-b1ae-4c4c-882b-387c33b5c88e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:07.284026 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7f3a650-b1ae-4c4c-882b-387c33b5c88e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:07.284470 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7f3a650-b1ae-4c4c-882b-387c33b5c88e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:07.285167 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7f3a650-b1ae-4c4c-882b-387c33b5c88e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:07.285627 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7f3a650-b1ae-4c4c-882b-387c33b5c88e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:07.286058 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7f3a650-b1ae-4c4c-882b-387c33b5c88e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:07.420737 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e7f3a650-b1ae-4c4c-882b-387c33b5c88e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:07.428213 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e7f3a650-b1ae-4c4c-882b-387c33b5c88e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1510 microversion: 2.1 time: 0.155819 Aug 08 14:34:07.428774 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 262/494] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:07 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:07.845860 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f95fd34d-5db3-4a77-9cad-74ea7eb4668e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:07.846477 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f95fd34d-5db3-4a77-9cad-74ea7eb4668e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:07.862343 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f95fd34d-5db3-4a77-9cad-74ea7eb4668e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:07.863406 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f95fd34d-5db3-4a77-9cad-74ea7eb4668e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:07.864079 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f95fd34d-5db3-4a77-9cad-74ea7eb4668e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:07.865011 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f95fd34d-5db3-4a77-9cad-74ea7eb4668e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:07.866486 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f95fd34d-5db3-4a77-9cad-74ea7eb4668e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:07.867187 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f95fd34d-5db3-4a77-9cad-74ea7eb4668e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:08.268692 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f95fd34d-5db3-4a77-9cad-74ea7eb4668e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:08.282634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f95fd34d-5db3-4a77-9cad-74ea7eb4668e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:08.285368 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f95fd34d-5db3-4a77-9cad-74ea7eb4668e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:08.286928 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f95fd34d-5db3-4a77-9cad-74ea7eb4668e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.444963 Aug 08 14:34:08.288902 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3ea97872-fa45-42dd-9245-b6139609a9b7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:08.289618 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3ea97872-fa45-42dd-9245-b6139609a9b7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:08.296909 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 233/495] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:07 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:08.301993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3ea97872-fa45-42dd-9245-b6139609a9b7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:08.308973 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3ea97872-fa45-42dd-9245-b6139609a9b7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:08.309425 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3ea97872-fa45-42dd-9245-b6139609a9b7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:08.310167 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3ea97872-fa45-42dd-9245-b6139609a9b7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:08.310621 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3ea97872-fa45-42dd-9245-b6139609a9b7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:08.311260 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3ea97872-fa45-42dd-9245-b6139609a9b7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:08.433547 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3ea97872-fa45-42dd-9245-b6139609a9b7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:08.444664 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3ea97872-fa45-42dd-9245-b6139609a9b7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1205 microversion: 2.1 time: 0.159864 Aug 08 14:34:08.464231 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9f6e0b47-15c9-4062-ae96-07cc876bebec tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:08.465017 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9f6e0b47-15c9-4062-ae96-07cc876bebec tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:08.468613 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 263/496] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:08 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1205 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:08.472643 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9f6e0b47-15c9-4062-ae96-07cc876bebec tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:08.473549 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9f6e0b47-15c9-4062-ae96-07cc876bebec tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:08.475393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9f6e0b47-15c9-4062-ae96-07cc876bebec tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:08.476414 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9f6e0b47-15c9-4062-ae96-07cc876bebec tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:08.477158 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9f6e0b47-15c9-4062-ae96-07cc876bebec tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:08.477828 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9f6e0b47-15c9-4062-ae96-07cc876bebec tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:08.769779 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9f6e0b47-15c9-4062-ae96-07cc876bebec tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:08.793850 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9f6e0b47-15c9-4062-ae96-07cc876bebec tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1510 microversion: 2.1 time: 0.336185 Aug 08 14:34:08.803375 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 234/497] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:08 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1510 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:09.321559 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-25c65297-dcb2-4912-b3dd-0a5c5aabf475 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:09.322187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-25c65297-dcb2-4912-b3dd-0a5c5aabf475 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:09.328133 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-25c65297-dcb2-4912-b3dd-0a5c5aabf475 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:09.328620 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-25c65297-dcb2-4912-b3dd-0a5c5aabf475 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:09.329058 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-25c65297-dcb2-4912-b3dd-0a5c5aabf475 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:09.329756 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-25c65297-dcb2-4912-b3dd-0a5c5aabf475 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:09.330214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-25c65297-dcb2-4912-b3dd-0a5c5aabf475 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:09.330642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-25c65297-dcb2-4912-b3dd-0a5c5aabf475 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:09.464641 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-25c65297-dcb2-4912-b3dd-0a5c5aabf475 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:09.467381 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2f0f2836-8331-449e-81af-d5c72c66983c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:09.468026 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2f0f2836-8331-449e-81af-d5c72c66983c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:09.474023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-25c65297-dcb2-4912-b3dd-0a5c5aabf475 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:09.474324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f0f2836-8331-449e-81af-d5c72c66983c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:09.474985 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-25c65297-dcb2-4912-b3dd-0a5c5aabf475 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:09.475223 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f0f2836-8331-449e-81af-d5c72c66983c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:09.475665 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f0f2836-8331-449e-81af-d5c72c66983c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:09.476166 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-25c65297-dcb2-4912-b3dd-0a5c5aabf475 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.160344 Aug 08 14:34:09.476367 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f0f2836-8331-449e-81af-d5c72c66983c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:09.476716 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 264/498] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:09 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:34:09.476866 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f0f2836-8331-449e-81af-d5c72c66983c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:09.477230 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f0f2836-8331-449e-81af-d5c72c66983c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:09.614104 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2f0f2836-8331-449e-81af-d5c72c66983c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:09.625939 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2f0f2836-8331-449e-81af-d5c72c66983c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.162704 Aug 08 14:34:09.626497 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 235/499] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:09 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:09.817019 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2c8939c4-45a9-4dea-b762-0e3c07eed38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:09.817656 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2c8939c4-45a9-4dea-b762-0e3c07eed38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:09.823723 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2c8939c4-45a9-4dea-b762-0e3c07eed38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:09.824213 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2c8939c4-45a9-4dea-b762-0e3c07eed38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:09.824650 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2c8939c4-45a9-4dea-b762-0e3c07eed38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:09.825343 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2c8939c4-45a9-4dea-b762-0e3c07eed38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:09.825807 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2c8939c4-45a9-4dea-b762-0e3c07eed38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:09.826226 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2c8939c4-45a9-4dea-b762-0e3c07eed38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:09.957517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2c8939c4-45a9-4dea-b762-0e3c07eed38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:09.965079 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2c8939c4-45a9-4dea-b762-0e3c07eed38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1510 microversion: 2.1 time: 0.151932 Aug 08 14:34:09.965650 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 265/500] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:09 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:10.499593 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ad3b2c39-9b72-4f8a-8428-0405c871225c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:10.500184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ad3b2c39-9b72-4f8a-8428-0405c871225c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:10.507457 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad3b2c39-9b72-4f8a-8428-0405c871225c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:10.507946 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad3b2c39-9b72-4f8a-8428-0405c871225c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:10.508387 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad3b2c39-9b72-4f8a-8428-0405c871225c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:10.509106 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad3b2c39-9b72-4f8a-8428-0405c871225c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:10.509554 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad3b2c39-9b72-4f8a-8428-0405c871225c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:10.509975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad3b2c39-9b72-4f8a-8428-0405c871225c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:10.513972 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=100 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:10.647595 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-47520993-0c7f-401b-ae1e-288e75b40d14 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:10.648245 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-47520993-0c7f-401b-ae1e-288e75b40d14 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:10.648379 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ad3b2c39-9b72-4f8a-8428-0405c871225c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:10.650722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=72 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:10.657122 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47520993-0c7f-401b-ae1e-288e75b40d14 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:10.657345 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ad3b2c39-9b72-4f8a-8428-0405c871225c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:10.657616 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47520993-0c7f-401b-ae1e-288e75b40d14 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:10.658054 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47520993-0c7f-401b-ae1e-288e75b40d14 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:10.658717 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ad3b2c39-9b72-4f8a-8428-0405c871225c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:10.658909 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47520993-0c7f-401b-ae1e-288e75b40d14 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:10.659245 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47520993-0c7f-401b-ae1e-288e75b40d14 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:10.659668 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47520993-0c7f-401b-ae1e-288e75b40d14 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:10.659930 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ad3b2c39-9b72-4f8a-8428-0405c871225c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.164246 Aug 08 14:34:10.660492 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 236/501] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:10 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:10.813338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-47520993-0c7f-401b-ae1e-288e75b40d14 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:10.821237 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-47520993-0c7f-401b-ae1e-288e75b40d14 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.178100 Aug 08 14:34:10.821812 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 266/502] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:10 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:10.986431 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f8e2b4da-dae6-4447-8b3d-f19f72ef35f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:10.986948 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f8e2b4da-dae6-4447-8b3d-f19f72ef35f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:10.993372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8e2b4da-dae6-4447-8b3d-f19f72ef35f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:10.993852 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8e2b4da-dae6-4447-8b3d-f19f72ef35f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:10.994285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8e2b4da-dae6-4447-8b3d-f19f72ef35f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:10.994963 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8e2b4da-dae6-4447-8b3d-f19f72ef35f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:10.995675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8e2b4da-dae6-4447-8b3d-f19f72ef35f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:10.995842 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8e2b4da-dae6-4447-8b3d-f19f72ef35f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:11.139021 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f8e2b4da-dae6-4447-8b3d-f19f72ef35f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:11.146944 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f8e2b4da-dae6-4447-8b3d-f19f72ef35f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1510 microversion: 2.1 time: 0.163965 Aug 08 14:34:11.147538 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 237/503] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:10 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:11.689188 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-879939f0-9162-485c-8ff8-34aaca8cac5c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:11.689798 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-879939f0-9162-485c-8ff8-34aaca8cac5c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:11.697046 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-879939f0-9162-485c-8ff8-34aaca8cac5c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:11.697534 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-879939f0-9162-485c-8ff8-34aaca8cac5c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:11.697979 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-879939f0-9162-485c-8ff8-34aaca8cac5c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:11.698675 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-879939f0-9162-485c-8ff8-34aaca8cac5c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:11.699162 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-879939f0-9162-485c-8ff8-34aaca8cac5c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:11.699588 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-879939f0-9162-485c-8ff8-34aaca8cac5c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:11.832915 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-879939f0-9162-485c-8ff8-34aaca8cac5c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:11.841475 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-879939f0-9162-485c-8ff8-34aaca8cac5c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:11.841669 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e96c2d79-c26c-4f45-a664-d758c15802e1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:11.842211 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e96c2d79-c26c-4f45-a664-d758c15802e1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:11.843026 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-879939f0-9162-485c-8ff8-34aaca8cac5c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:11.844216 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-879939f0-9162-485c-8ff8-34aaca8cac5c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.158997 Aug 08 14:34:11.844776 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 267/504] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:11 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:11.848628 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e96c2d79-c26c-4f45-a664-d758c15802e1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:11.849104 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e96c2d79-c26c-4f45-a664-d758c15802e1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:11.849591 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e96c2d79-c26c-4f45-a664-d758c15802e1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:11.850271 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e96c2d79-c26c-4f45-a664-d758c15802e1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:11.850724 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e96c2d79-c26c-4f45-a664-d758c15802e1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:11.851166 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e96c2d79-c26c-4f45-a664-d758c15802e1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:11.980847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e96c2d79-c26c-4f45-a664-d758c15802e1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:11.988257 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e96c2d79-c26c-4f45-a664-d758c15802e1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.150436 Aug 08 14:34:11.988825 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 238/505] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:11 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:12.168323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3f7ae2b0-75e6-4d32-9cd6-c5fbad088360 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:12.168928 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3f7ae2b0-75e6-4d32-9cd6-c5fbad088360 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:12.174893 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3f7ae2b0-75e6-4d32-9cd6-c5fbad088360 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:12.175404 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3f7ae2b0-75e6-4d32-9cd6-c5fbad088360 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:12.175838 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3f7ae2b0-75e6-4d32-9cd6-c5fbad088360 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:12.176520 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3f7ae2b0-75e6-4d32-9cd6-c5fbad088360 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:12.176969 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3f7ae2b0-75e6-4d32-9cd6-c5fbad088360 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:12.177388 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3f7ae2b0-75e6-4d32-9cd6-c5fbad088360 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:12.195769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:12.311987 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3f7ae2b0-75e6-4d32-9cd6-c5fbad088360 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:12.319912 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3f7ae2b0-75e6-4d32-9cd6-c5fbad088360 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1510 microversion: 2.1 time: 0.155727 Aug 08 14:34:12.320496 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 268/506] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:12 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:12.868211 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-31be3ac8-1398-40f8-a5cf-592c56d55c5d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:12.868824 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-31be3ac8-1398-40f8-a5cf-592c56d55c5d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:12.875405 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31be3ac8-1398-40f8-a5cf-592c56d55c5d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:12.875898 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31be3ac8-1398-40f8-a5cf-592c56d55c5d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:12.876368 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31be3ac8-1398-40f8-a5cf-592c56d55c5d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:12.877073 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31be3ac8-1398-40f8-a5cf-592c56d55c5d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:12.877538 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31be3ac8-1398-40f8-a5cf-592c56d55c5d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:12.877966 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31be3ac8-1398-40f8-a5cf-592c56d55c5d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:13.009279 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-28d21b9c-6459-427e-99d0-052c81eaa715 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:13.009896 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-28d21b9c-6459-427e-99d0-052c81eaa715 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:13.016502 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-28d21b9c-6459-427e-99d0-052c81eaa715 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:13.016987 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-28d21b9c-6459-427e-99d0-052c81eaa715 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:13.017447 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-28d21b9c-6459-427e-99d0-052c81eaa715 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:13.018256 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-28d21b9c-6459-427e-99d0-052c81eaa715 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:13.018634 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-28d21b9c-6459-427e-99d0-052c81eaa715 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:13.019056 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-28d21b9c-6459-427e-99d0-052c81eaa715 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:13.019346 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-31be3ac8-1398-40f8-a5cf-592c56d55c5d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:13.030930 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-31be3ac8-1398-40f8-a5cf-592c56d55c5d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:13.033318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-31be3ac8-1398-40f8-a5cf-592c56d55c5d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:13.034609 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-31be3ac8-1398-40f8-a5cf-592c56d55c5d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.171270 Aug 08 14:34:13.035416 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 239/507] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:12 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:13.068044 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-c5a2d5e1-5224-4445-bc98-5dd91842983d req-785b97d1-a000-4403-8f02-f9f2727bad04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0245e7-b0d0-4fbe-a233-4b3e7768b94c", "name": "network-vif-plugged", "status": "completed", "tag": "87f964c5-59f7-49fd-885c-ebcb610ccd3e"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:13.073938 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:13.080555 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-c5a2d5e1-5224-4445-bc98-5dd91842983d req-785b97d1-a000-4403-8f02-f9f2727bad04 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:13.081039 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-c5a2d5e1-5224-4445-bc98-5dd91842983d req-785b97d1-a000-4403-8f02-f9f2727bad04 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:13.083133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-c5a2d5e1-5224-4445-bc98-5dd91842983d req-785b97d1-a000-4403-8f02-f9f2727bad04 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:13.093994 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-c5a2d5e1-5224-4445-bc98-5dd91842983d req-785b97d1-a000-4403-8f02-f9f2727bad04 service nova] Creating event network-vif-plugged:87f964c5-59f7-49fd-885c-ebcb610ccd3e for instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c on hv-cinder-85200 Aug 08 14:34:13.100246 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-c5a2d5e1-5224-4445-bc98-5dd91842983d req-785b97d1-a000-4403-8f02-f9f2727bad04 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049169 Aug 08 14:34:13.100857 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 240/508] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:34:13.194666 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-28d21b9c-6459-427e-99d0-052c81eaa715 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:13.202199 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-28d21b9c-6459-427e-99d0-052c81eaa715 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.197353 Aug 08 14:34:13.202760 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 269/509] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:13 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:13.341651 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-17a402ee-ac37-4678-b038-4c7deecfdb67 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:13.342245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-17a402ee-ac37-4678-b038-4c7deecfdb67 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:13.350063 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17a402ee-ac37-4678-b038-4c7deecfdb67 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:13.350541 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17a402ee-ac37-4678-b038-4c7deecfdb67 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:13.350971 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17a402ee-ac37-4678-b038-4c7deecfdb67 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:13.351702 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17a402ee-ac37-4678-b038-4c7deecfdb67 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:13.352132 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17a402ee-ac37-4678-b038-4c7deecfdb67 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:13.352550 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17a402ee-ac37-4678-b038-4c7deecfdb67 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:13.487312 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-17a402ee-ac37-4678-b038-4c7deecfdb67 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:13.494725 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-17a402ee-ac37-4678-b038-4c7deecfdb67 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1510 microversion: 2.1 time: 0.157378 Aug 08 14:34:13.495326 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 241/510] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:13 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:14.065422 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6f77a7c5-ab79-43d1-9ea4-7506c2f8733c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:14.066182 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6f77a7c5-ab79-43d1-9ea4-7506c2f8733c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:14.073896 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f77a7c5-ab79-43d1-9ea4-7506c2f8733c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:14.074632 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f77a7c5-ab79-43d1-9ea4-7506c2f8733c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:14.075071 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f77a7c5-ab79-43d1-9ea4-7506c2f8733c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:14.075810 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f77a7c5-ab79-43d1-9ea4-7506c2f8733c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:14.076268 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f77a7c5-ab79-43d1-9ea4-7506c2f8733c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:14.076698 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f77a7c5-ab79-43d1-9ea4-7506c2f8733c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:14.215344 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6f77a7c5-ab79-43d1-9ea4-7506c2f8733c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:14.224108 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9509a214-9152-414b-81c4-1ed301de4ffa tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:14.224644 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6f77a7c5-ab79-43d1-9ea4-7506c2f8733c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:14.225418 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9509a214-9152-414b-81c4-1ed301de4ffa tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:14.226177 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6f77a7c5-ab79-43d1-9ea4-7506c2f8733c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:14.227503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6f77a7c5-ab79-43d1-9ea4-7506c2f8733c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.166591 Aug 08 14:34:14.227641 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:14.228397 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 270/511] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:14 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:14.229014 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=8 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:14.234928 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9509a214-9152-414b-81c4-1ed301de4ffa tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:14.235645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9509a214-9152-414b-81c4-1ed301de4ffa tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:14.236074 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9509a214-9152-414b-81c4-1ed301de4ffa tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:14.236772 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9509a214-9152-414b-81c4-1ed301de4ffa tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:14.237526 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9509a214-9152-414b-81c4-1ed301de4ffa tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:14.237656 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9509a214-9152-414b-81c4-1ed301de4ffa tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:14.340715 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-62ab68b1-ba9a-434a-a3bc-603054e723fb req-fb17f3b8-f643-4e3c-80ab-b2b87f7b69e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eff17af-e081-4582-82fb-ba2f7a45c338", "tag": "54289b72-3379-4dba-9ae7-835b040e581b"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:14.351407 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-62ab68b1-ba9a-434a-a3bc-603054e723fb req-fb17f3b8-f643-4e3c-80ab-b2b87f7b69e8 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:14.351887 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-62ab68b1-ba9a-434a-a3bc-603054e723fb req-fb17f3b8-f643-4e3c-80ab-b2b87f7b69e8 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:14.352315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-62ab68b1-ba9a-434a-a3bc-603054e723fb req-fb17f3b8-f643-4e3c-80ab-b2b87f7b69e8 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:14.364748 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-62ab68b1-ba9a-434a-a3bc-603054e723fb req-fb17f3b8-f643-4e3c-80ab-b2b87f7b69e8 service nova] Creating event network-changed:54289b72-3379-4dba-9ae7-835b040e581b for instance 0eff17af-e081-4582-82fb-ba2f7a45c338 on hv-cinder-85200 Aug 08 14:34:14.370186 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-62ab68b1-ba9a-434a-a3bc-603054e723fb req-fb17f3b8-f643-4e3c-80ab-b2b87f7b69e8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035934 Aug 08 14:34:14.370785 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 271/512] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:34:14.392554 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9509a214-9152-414b-81c4-1ed301de4ffa tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:14.400326 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9509a214-9152-414b-81c4-1ed301de4ffa tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.181232 Aug 08 14:34:14.400776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 242/513] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:14 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:14.516949 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a562f236-6e31-4186-a759-11881ddf1d59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:14.517633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-a562f236-6e31-4186-a759-11881ddf1d59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:14.523807 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a562f236-6e31-4186-a759-11881ddf1d59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:14.524281 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a562f236-6e31-4186-a759-11881ddf1d59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:14.524713 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a562f236-6e31-4186-a759-11881ddf1d59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:14.525400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a562f236-6e31-4186-a759-11881ddf1d59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:14.525848 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a562f236-6e31-4186-a759-11881ddf1d59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:14.526267 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a562f236-6e31-4186-a759-11881ddf1d59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:14.658879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-a562f236-6e31-4186-a759-11881ddf1d59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:14.667470 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-a562f236-6e31-4186-a759-11881ddf1d59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1510 microversion: 2.1 time: 0.154686 Aug 08 14:34:14.668041 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 272/514] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:14 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:15.251771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5e93bd9d-217c-43b9-85bb-4ddd84651264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:15.252316 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5e93bd9d-217c-43b9-85bb-4ddd84651264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:15.259177 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e93bd9d-217c-43b9-85bb-4ddd84651264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:15.259664 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e93bd9d-217c-43b9-85bb-4ddd84651264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:15.260097 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e93bd9d-217c-43b9-85bb-4ddd84651264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:15.260783 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e93bd9d-217c-43b9-85bb-4ddd84651264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:15.261231 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e93bd9d-217c-43b9-85bb-4ddd84651264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:15.261655 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e93bd9d-217c-43b9-85bb-4ddd84651264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:15.395607 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5e93bd9d-217c-43b9-85bb-4ddd84651264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:15.404573 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5e93bd9d-217c-43b9-85bb-4ddd84651264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:15.406103 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5e93bd9d-217c-43b9-85bb-4ddd84651264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:15.407282 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5e93bd9d-217c-43b9-85bb-4ddd84651264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.159507 Aug 08 14:34:15.407839 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 243/515] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:15 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:15.421095 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1b1d5491-90a3-45f1-8106-ac02a6cbc2ec tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:15.421734 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1b1d5491-90a3-45f1-8106-ac02a6cbc2ec tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:15.428631 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1b1d5491-90a3-45f1-8106-ac02a6cbc2ec tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:15.429109 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1b1d5491-90a3-45f1-8106-ac02a6cbc2ec tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:15.429545 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1b1d5491-90a3-45f1-8106-ac02a6cbc2ec tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:15.430233 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1b1d5491-90a3-45f1-8106-ac02a6cbc2ec tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:15.430685 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1b1d5491-90a3-45f1-8106-ac02a6cbc2ec tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:15.431127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1b1d5491-90a3-45f1-8106-ac02a6cbc2ec tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:15.564355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-1b1d5491-90a3-45f1-8106-ac02a6cbc2ec tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:15.572580 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1b1d5491-90a3-45f1-8106-ac02a6cbc2ec tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.155354 Aug 08 14:34:15.573141 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 273/516] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:15 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:15.688773 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ee00af80-a538-4f40-821f-a4ea20459f63 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:15.689368 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ee00af80-a538-4f40-821f-a4ea20459f63 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:15.696027 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ee00af80-a538-4f40-821f-a4ea20459f63 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:15.696500 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ee00af80-a538-4f40-821f-a4ea20459f63 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:15.696930 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ee00af80-a538-4f40-821f-a4ea20459f63 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:15.697615 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ee00af80-a538-4f40-821f-a4ea20459f63 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:15.698060 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ee00af80-a538-4f40-821f-a4ea20459f63 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:15.698476 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ee00af80-a538-4f40-821f-a4ea20459f63 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:15.828825 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ee00af80-a538-4f40-821f-a4ea20459f63 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:15.836381 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ee00af80-a538-4f40-821f-a4ea20459f63 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1510 microversion: 2.1 time: 0.151434 Aug 08 14:34:15.836958 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 244/517] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:15 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:16.429869 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-afb61f8f-e7cd-4403-9fbb-86c0223633d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:16.430480 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-afb61f8f-e7cd-4403-9fbb-86c0223633d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:16.436913 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-afb61f8f-e7cd-4403-9fbb-86c0223633d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:16.437403 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-afb61f8f-e7cd-4403-9fbb-86c0223633d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:16.437836 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-afb61f8f-e7cd-4403-9fbb-86c0223633d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:16.438529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-afb61f8f-e7cd-4403-9fbb-86c0223633d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:16.438987 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-afb61f8f-e7cd-4403-9fbb-86c0223633d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:16.439446 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-afb61f8f-e7cd-4403-9fbb-86c0223633d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:16.575816 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-afb61f8f-e7cd-4403-9fbb-86c0223633d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:16.585317 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-afb61f8f-e7cd-4403-9fbb-86c0223633d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:16.586876 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-afb61f8f-e7cd-4403-9fbb-86c0223633d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:16.588100 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-afb61f8f-e7cd-4403-9fbb-86c0223633d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.162179 Aug 08 14:34:16.588665 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 274/518] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:16 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:16.592463 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b6a40118-9eb3-4c47-9853-63500fee8727 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:16.593062 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b6a40118-9eb3-4c47-9853-63500fee8727 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:16.599793 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b6a40118-9eb3-4c47-9853-63500fee8727 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:16.600202 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b6a40118-9eb3-4c47-9853-63500fee8727 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:16.600630 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b6a40118-9eb3-4c47-9853-63500fee8727 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:16.601318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b6a40118-9eb3-4c47-9853-63500fee8727 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:16.601762 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b6a40118-9eb3-4c47-9853-63500fee8727 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:16.602178 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b6a40118-9eb3-4c47-9853-63500fee8727 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:16.732271 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b6a40118-9eb3-4c47-9853-63500fee8727 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:16.739725 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b6a40118-9eb3-4c47-9853-63500fee8727 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.151223 Aug 08 14:34:16.740295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 245/519] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:16 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:16.857810 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-65ef8c78-374c-4266-8f09-38881f3d3153 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:16.858451 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-65ef8c78-374c-4266-8f09-38881f3d3153 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:16.864910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65ef8c78-374c-4266-8f09-38881f3d3153 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:16.865400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65ef8c78-374c-4266-8f09-38881f3d3153 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:16.865840 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65ef8c78-374c-4266-8f09-38881f3d3153 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:16.866567 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65ef8c78-374c-4266-8f09-38881f3d3153 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:16.867025 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65ef8c78-374c-4266-8f09-38881f3d3153 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:16.867489 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-65ef8c78-374c-4266-8f09-38881f3d3153 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:16.999352 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-65ef8c78-374c-4266-8f09-38881f3d3153 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:17.007426 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-65ef8c78-374c-4266-8f09-38881f3d3153 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1510 microversion: 2.1 time: 0.153530 Aug 08 14:34:17.007993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 275/520] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:16 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:17.610991 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ab75f2dd-be9d-4ff5-a21c-1d7399d63e03 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:17.611606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ab75f2dd-be9d-4ff5-a21c-1d7399d63e03 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:17.618814 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ab75f2dd-be9d-4ff5-a21c-1d7399d63e03 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:17.619319 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ab75f2dd-be9d-4ff5-a21c-1d7399d63e03 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:17.619751 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ab75f2dd-be9d-4ff5-a21c-1d7399d63e03 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:17.620599 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ab75f2dd-be9d-4ff5-a21c-1d7399d63e03 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:17.621100 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ab75f2dd-be9d-4ff5-a21c-1d7399d63e03 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:17.621520 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ab75f2dd-be9d-4ff5-a21c-1d7399d63e03 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:17.753618 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ab75f2dd-be9d-4ff5-a21c-1d7399d63e03 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:17.759805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6d8954bb-3f31-4cc9-85b1-0db800dd8cf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:17.760419 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6d8954bb-3f31-4cc9-85b1-0db800dd8cf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:17.762839 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ab75f2dd-be9d-4ff5-a21c-1d7399d63e03 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:17.764479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ab75f2dd-be9d-4ff5-a21c-1d7399d63e03 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:17.765706 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ab75f2dd-be9d-4ff5-a21c-1d7399d63e03 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.158639 Aug 08 14:34:17.766373 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 246/521] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:17 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:17.766785 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d8954bb-3f31-4cc9-85b1-0db800dd8cf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:17.767307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d8954bb-3f31-4cc9-85b1-0db800dd8cf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:17.767743 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d8954bb-3f31-4cc9-85b1-0db800dd8cf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:17.768431 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d8954bb-3f31-4cc9-85b1-0db800dd8cf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:17.768878 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d8954bb-3f31-4cc9-85b1-0db800dd8cf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:17.769297 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6d8954bb-3f31-4cc9-85b1-0db800dd8cf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:17.909922 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6d8954bb-3f31-4cc9-85b1-0db800dd8cf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:17.918418 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6d8954bb-3f31-4cc9-85b1-0db800dd8cf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.162484 Aug 08 14:34:17.918990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 276/522] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:17 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:18.028419 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c9ce703a-076c-4890-9791-071c0098694a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:18.029016 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c9ce703a-076c-4890-9791-071c0098694a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:18.035313 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9ce703a-076c-4890-9791-071c0098694a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:18.035800 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9ce703a-076c-4890-9791-071c0098694a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:18.036234 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9ce703a-076c-4890-9791-071c0098694a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:18.036929 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9ce703a-076c-4890-9791-071c0098694a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:18.037411 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9ce703a-076c-4890-9791-071c0098694a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:18.037836 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9ce703a-076c-4890-9791-071c0098694a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:18.189140 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c9ce703a-076c-4890-9791-071c0098694a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:18.197660 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c9ce703a-076c-4890-9791-071c0098694a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1510 microversion: 2.1 time: 0.172873 Aug 08 14:34:18.198568 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 247/523] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:18 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:18.790747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f2e2e76a-ce1e-4db8-82c2-82d6339222c4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:18.791565 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f2e2e76a-ce1e-4db8-82c2-82d6339222c4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:18.800785 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2e2e76a-ce1e-4db8-82c2-82d6339222c4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:18.801278 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2e2e76a-ce1e-4db8-82c2-82d6339222c4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:18.801712 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2e2e76a-ce1e-4db8-82c2-82d6339222c4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:18.802989 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2e2e76a-ce1e-4db8-82c2-82d6339222c4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:18.803477 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2e2e76a-ce1e-4db8-82c2-82d6339222c4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:18.803905 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2e2e76a-ce1e-4db8-82c2-82d6339222c4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:18.937910 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5dabcf2f-b5fb-462e-8deb-2213c9a9fc0c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:18.938867 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5dabcf2f-b5fb-462e-8deb-2213c9a9fc0c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:18.945558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5dabcf2f-b5fb-462e-8deb-2213c9a9fc0c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:18.946178 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5dabcf2f-b5fb-462e-8deb-2213c9a9fc0c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:18.946849 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5dabcf2f-b5fb-462e-8deb-2213c9a9fc0c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:18.947687 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5dabcf2f-b5fb-462e-8deb-2213c9a9fc0c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:18.948241 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5dabcf2f-b5fb-462e-8deb-2213c9a9fc0c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:18.948761 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5dabcf2f-b5fb-462e-8deb-2213c9a9fc0c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:18.967873 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f2e2e76a-ce1e-4db8-82c2-82d6339222c4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:18.977252 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f2e2e76a-ce1e-4db8-82c2-82d6339222c4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:18.979311 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f2e2e76a-ce1e-4db8-82c2-82d6339222c4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:18.980484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f2e2e76a-ce1e-4db8-82c2-82d6339222c4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.195472 Aug 08 14:34:18.981047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 277/524] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:18 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:19.083852 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5dabcf2f-b5fb-462e-8deb-2213c9a9fc0c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:19.091361 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5dabcf2f-b5fb-462e-8deb-2213c9a9fc0c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.157311 Aug 08 14:34:19.091927 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 248/525] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:18 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:19.220043 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2b883969-432f-4bc8-8ab1-2b55f28c7cba tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:19.220648 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2b883969-432f-4bc8-8ab1-2b55f28c7cba tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:19.227162 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b883969-432f-4bc8-8ab1-2b55f28c7cba tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:19.227651 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b883969-432f-4bc8-8ab1-2b55f28c7cba tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:19.228091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b883969-432f-4bc8-8ab1-2b55f28c7cba tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:19.228783 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b883969-432f-4bc8-8ab1-2b55f28c7cba tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:19.229242 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b883969-432f-4bc8-8ab1-2b55f28c7cba tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:19.229693 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b883969-432f-4bc8-8ab1-2b55f28c7cba tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:19.363458 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2b883969-432f-4bc8-8ab1-2b55f28c7cba tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:19.370910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2b883969-432f-4bc8-8ab1-2b55f28c7cba tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1516 microversion: 2.1 time: 0.154705 Aug 08 14:34:19.371509 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 278/526] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:19 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:20.004362 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9c6c3285-b5cc-4c12-9b2b-3a0cf071727b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:20.004973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9c6c3285-b5cc-4c12-9b2b-3a0cf071727b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:20.012040 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c6c3285-b5cc-4c12-9b2b-3a0cf071727b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:20.012520 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c6c3285-b5cc-4c12-9b2b-3a0cf071727b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:20.012948 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c6c3285-b5cc-4c12-9b2b-3a0cf071727b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:20.013633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c6c3285-b5cc-4c12-9b2b-3a0cf071727b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:20.014079 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c6c3285-b5cc-4c12-9b2b-3a0cf071727b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:20.014502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c6c3285-b5cc-4c12-9b2b-3a0cf071727b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:20.112190 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6b789d62-d412-40d5-898f-82c1cb733149 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:20.112893 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6b789d62-d412-40d5-898f-82c1cb733149 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:20.119905 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b789d62-d412-40d5-898f-82c1cb733149 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:20.120393 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b789d62-d412-40d5-898f-82c1cb733149 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:20.120828 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b789d62-d412-40d5-898f-82c1cb733149 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:20.121531 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b789d62-d412-40d5-898f-82c1cb733149 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:20.121987 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b789d62-d412-40d5-898f-82c1cb733149 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:20.122408 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b789d62-d412-40d5-898f-82c1cb733149 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:20.146883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9c6c3285-b5cc-4c12-9b2b-3a0cf071727b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:20.155564 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9c6c3285-b5cc-4c12-9b2b-3a0cf071727b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:20.157090 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9c6c3285-b5cc-4c12-9b2b-3a0cf071727b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:20.158263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9c6c3285-b5cc-4c12-9b2b-3a0cf071727b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.157922 Aug 08 14:34:20.158823 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 249/527] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:19 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:20.256485 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6b789d62-d412-40d5-898f-82c1cb733149 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:20.264055 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6b789d62-d412-40d5-898f-82c1cb733149 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.155781 Aug 08 14:34:20.264623 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 279/528] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:20 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:21.181656 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d9e4ddeb-0de4-42f0-a0de-06bc6a95c02c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:21.182232 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d9e4ddeb-0de4-42f0-a0de-06bc6a95c02c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:21.189125 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d9e4ddeb-0de4-42f0-a0de-06bc6a95c02c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:21.189608 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d9e4ddeb-0de4-42f0-a0de-06bc6a95c02c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:21.190043 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d9e4ddeb-0de4-42f0-a0de-06bc6a95c02c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:21.190739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d9e4ddeb-0de4-42f0-a0de-06bc6a95c02c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:21.191221 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d9e4ddeb-0de4-42f0-a0de-06bc6a95c02c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:21.191641 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d9e4ddeb-0de4-42f0-a0de-06bc6a95c02c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:21.284388 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-db915175-a21f-4536-8355-f5fadf9ef0c2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:21.285002 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-db915175-a21f-4536-8355-f5fadf9ef0c2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:21.293522 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db915175-a21f-4536-8355-f5fadf9ef0c2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:21.294035 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db915175-a21f-4536-8355-f5fadf9ef0c2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:21.294469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db915175-a21f-4536-8355-f5fadf9ef0c2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:21.295193 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db915175-a21f-4536-8355-f5fadf9ef0c2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:21.295654 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db915175-a21f-4536-8355-f5fadf9ef0c2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:21.296080 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db915175-a21f-4536-8355-f5fadf9ef0c2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:21.347607 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d9e4ddeb-0de4-42f0-a0de-06bc6a95c02c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:21.356359 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d9e4ddeb-0de4-42f0-a0de-06bc6a95c02c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:21.357883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d9e4ddeb-0de4-42f0-a0de-06bc6a95c02c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:21.359058 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d9e4ddeb-0de4-42f0-a0de-06bc6a95c02c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.181504 Aug 08 14:34:21.359642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 250/529] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:21 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:21.438461 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-db915175-a21f-4536-8355-f5fadf9ef0c2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:21.446600 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-db915175-a21f-4536-8355-f5fadf9ef0c2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.166102 Aug 08 14:34:21.447191 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 280/530] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:21 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:22.381983 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a6b18886-efbc-461b-b61f-b6b974953e89 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:22.382585 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a6b18886-efbc-461b-b61f-b6b974953e89 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:22.389397 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a6b18886-efbc-461b-b61f-b6b974953e89 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:22.389751 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a6b18886-efbc-461b-b61f-b6b974953e89 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:22.390193 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a6b18886-efbc-461b-b61f-b6b974953e89 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:22.390923 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a6b18886-efbc-461b-b61f-b6b974953e89 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:22.392078 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a6b18886-efbc-461b-b61f-b6b974953e89 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:22.392078 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a6b18886-efbc-461b-b61f-b6b974953e89 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:22.467335 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-12c1d852-761a-4dd8-adf3-0147efea977d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:22.468073 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-12c1d852-761a-4dd8-adf3-0147efea977d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:22.475991 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-12c1d852-761a-4dd8-adf3-0147efea977d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:22.476494 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-12c1d852-761a-4dd8-adf3-0147efea977d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:22.476924 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-12c1d852-761a-4dd8-adf3-0147efea977d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:22.477827 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-12c1d852-761a-4dd8-adf3-0147efea977d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:22.478466 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-12c1d852-761a-4dd8-adf3-0147efea977d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:22.478904 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-12c1d852-761a-4dd8-adf3-0147efea977d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:22.542370 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a6b18886-efbc-461b-b61f-b6b974953e89 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:22.551129 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a6b18886-efbc-461b-b61f-b6b974953e89 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:22.552705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a6b18886-efbc-461b-b61f-b6b974953e89 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:22.553915 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a6b18886-efbc-461b-b61f-b6b974953e89 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.175959 Aug 08 14:34:22.554557 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 251/531] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:22 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:22.636861 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-12c1d852-761a-4dd8-adf3-0147efea977d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:22.644350 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-12c1d852-761a-4dd8-adf3-0147efea977d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.181351 Aug 08 14:34:22.644922 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 281/532] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:22 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:22.827783 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-936d53a8-9219-40f4-ae54-91f8f46e8d0d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Action: 'create', calling method: .version_select at 0x7f9cb26e2700>, body: {"keypair": {"name": "tempest-keypair-1193920526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGju1OTJWBWkUdIJ5BcCVJCccDibV5hai2QMXVpOV3A2zqF2KkXtgPgjoXAdPNvzA9uBu21XkfEpwLtwr+gd+8//fDpCiwqYdZrt1BHurY21F9cXnC+gnnNHs22JQI0a2g=="}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:22.845087 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-936d53a8-9219-40f4-ae54-91f8f46e8d0d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Getting quotas for project 6ecb83fbcae94dca82331ab87f028878. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:34:22.848966 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-936d53a8-9219-40f4-ae54-91f8f46e8d0d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Getting quotas for user 7d373dfa8c474ade92e94dc73dd9926f and project 6ecb83fbcae94dca82331ab87f028878. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:34:22.870886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-936d53a8-9219-40f4-ae54-91f8f46e8d0d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046940 Aug 08 14:34:22.871742 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 252/533] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 14:34:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:34:23.578898 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-53cf69fd-da77-4367-bcf0-f4f7a129f9b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:23.579775 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-53cf69fd-da77-4367-bcf0-f4f7a129f9b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:23.587050 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-53cf69fd-da77-4367-bcf0-f4f7a129f9b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:23.587750 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-53cf69fd-da77-4367-bcf0-f4f7a129f9b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:23.588533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-53cf69fd-da77-4367-bcf0-f4f7a129f9b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:23.589509 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-53cf69fd-da77-4367-bcf0-f4f7a129f9b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:23.590619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-53cf69fd-da77-4367-bcf0-f4f7a129f9b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:23.591344 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-53cf69fd-da77-4367-bcf0-f4f7a129f9b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:23.665628 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6bb6e69d-17b1-43ed-b04c-0a89b4b95361 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:23.666503 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6bb6e69d-17b1-43ed-b04c-0a89b4b95361 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:23.677332 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6bb6e69d-17b1-43ed-b04c-0a89b4b95361 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:23.678401 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6bb6e69d-17b1-43ed-b04c-0a89b4b95361 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:23.679109 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6bb6e69d-17b1-43ed-b04c-0a89b4b95361 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:23.680069 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6bb6e69d-17b1-43ed-b04c-0a89b4b95361 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:23.680747 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6bb6e69d-17b1-43ed-b04c-0a89b4b95361 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:23.681408 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6bb6e69d-17b1-43ed-b04c-0a89b4b95361 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:23.822142 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-53cf69fd-da77-4367-bcf0-f4f7a129f9b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:23.837845 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-53cf69fd-da77-4367-bcf0-f4f7a129f9b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:23.840787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-53cf69fd-da77-4367-bcf0-f4f7a129f9b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:23.844974 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-53cf69fd-da77-4367-bcf0-f4f7a129f9b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.271009 Aug 08 14:34:23.860816 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 282/534] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:23 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:23.917475 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6bb6e69d-17b1-43ed-b04c-0a89b4b95361 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:23.926972 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6bb6e69d-17b1-43ed-b04c-0a89b4b95361 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.265829 Aug 08 14:34:23.927842 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 253/535] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:23 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:24.354078 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1478286740", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5965902-5636-46a2-859e-f08b04b16ee2"}], "security_groups": [{"name": "tempest-securitygroup--1620801843"}], "key_name": "tempest-keypair-1193920526", "user_data": "}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:24.470969 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.network.neutron [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] validate_networks() for [('b5965902-5636-46a2-859e-f08b04b16ee2', None, None, None, None, None)] {{(pid=118062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:34:24.843269 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Flavor limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:34:24.843838 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Image limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:34:24.844176 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Flavor pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:34:24.844576 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Image pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:34:24.844983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:34:24.854119 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:24.854602 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:24.855030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:24.855781 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:24.856228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:24.856647 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:24.873265 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-774a8708-6ebe-4fb0-b0b5-58711c1aa9a7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:24.873814 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Getting quotas for project 6ecb83fbcae94dca82331ab87f028878. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:34:24.874119 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-774a8708-6ebe-4fb0-b0b5-58711c1aa9a7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:24.882497 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-774a8708-6ebe-4fb0-b0b5-58711c1aa9a7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:24.882989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-774a8708-6ebe-4fb0-b0b5-58711c1aa9a7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:24.883449 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-774a8708-6ebe-4fb0-b0b5-58711c1aa9a7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:24.884077 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Getting quotas for user 7d373dfa8c474ade92e94dc73dd9926f and project 6ecb83fbcae94dca82331ab87f028878. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:34:24.884303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-774a8708-6ebe-4fb0-b0b5-58711c1aa9a7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:24.884763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-774a8708-6ebe-4fb0-b0b5-58711c1aa9a7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:24.885186 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-774a8708-6ebe-4fb0-b0b5-58711c1aa9a7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:24.904052 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Going to run 1 instances... {{(pid=118062) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:34:24.905091 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=100 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:24.908428 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:34:24.962024 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ac916086-2c92-4e09-9b0a-31227885d0cd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.612779 Aug 08 14:34:24.962686 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 283/536] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:34:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 14:34:24.967377 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e7e29a10-036b-4fec-bb4d-c275f24086d3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:24.967986 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e7e29a10-036b-4fec-bb4d-c275f24086d3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:24.975080 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7e29a10-036b-4fec-bb4d-c275f24086d3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:24.978006 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7e29a10-036b-4fec-bb4d-c275f24086d3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:24.980715 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7e29a10-036b-4fec-bb4d-c275f24086d3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:24.984196 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7e29a10-036b-4fec-bb4d-c275f24086d3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:24.984454 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7e29a10-036b-4fec-bb4d-c275f24086d3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:24.985040 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e7e29a10-036b-4fec-bb4d-c275f24086d3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:25.061490 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-774a8708-6ebe-4fb0-b0b5-58711c1aa9a7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:25.074918 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-774a8708-6ebe-4fb0-b0b5-58711c1aa9a7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:25.079000 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-774a8708-6ebe-4fb0-b0b5-58711c1aa9a7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:25.081544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-774a8708-6ebe-4fb0-b0b5-58711c1aa9a7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.211283 Aug 08 14:34:25.082300 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 254/537] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:24 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:34:25.089735 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7fbe83ba-8063-483b-be1f-3bb35a9fa113 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:25.090358 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7fbe83ba-8063-483b-be1f-3bb35a9fa113 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:25.165140 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7fbe83ba-8063-483b-be1f-3bb35a9fa113 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:25.172717 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7fbe83ba-8063-483b-be1f-3bb35a9fa113 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1246 microversion: 2.1 time: 0.089169 Aug 08 14:34:25.173324 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 255/538] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:25 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:25.208035 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e7e29a10-036b-4fec-bb4d-c275f24086d3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:25.215978 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e7e29a10-036b-4fec-bb4d-c275f24086d3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.252234 Aug 08 14:34:25.216557 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 284/539] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:24 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:26.108610 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-992cf70e-47a7-4a3b-85d4-d2cd13ca9cd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:26.109182 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-992cf70e-47a7-4a3b-85d4-d2cd13ca9cd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:26.115608 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-992cf70e-47a7-4a3b-85d4-d2cd13ca9cd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:26.116095 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-992cf70e-47a7-4a3b-85d4-d2cd13ca9cd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:26.116532 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-992cf70e-47a7-4a3b-85d4-d2cd13ca9cd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:26.117221 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-992cf70e-47a7-4a3b-85d4-d2cd13ca9cd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:26.117676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-992cf70e-47a7-4a3b-85d4-d2cd13ca9cd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:26.118104 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-992cf70e-47a7-4a3b-85d4-d2cd13ca9cd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:26.193836 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9c9885b4-f67d-4dde-96aa-f83fe503fa13 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:26.194565 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9c9885b4-f67d-4dde-96aa-f83fe503fa13 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:26.201274 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9c9885b4-f67d-4dde-96aa-f83fe503fa13 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:26.201840 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9c9885b4-f67d-4dde-96aa-f83fe503fa13 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:26.202556 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9c9885b4-f67d-4dde-96aa-f83fe503fa13 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:26.203154 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9c9885b4-f67d-4dde-96aa-f83fe503fa13 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:26.203682 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9c9885b4-f67d-4dde-96aa-f83fe503fa13 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:26.204177 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9c9885b4-f67d-4dde-96aa-f83fe503fa13 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:26.265630 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-992cf70e-47a7-4a3b-85d4-d2cd13ca9cd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:26.274967 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-992cf70e-47a7-4a3b-85d4-d2cd13ca9cd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:26.276634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-992cf70e-47a7-4a3b-85d4-d2cd13ca9cd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:26.277837 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-992cf70e-47a7-4a3b-85d4-d2cd13ca9cd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.173293 Aug 08 14:34:26.278619 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 256/540] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:26 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:26.284264 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ba4f2a3d-ce40-41bd-825b-db0d6c4d1426 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:26.284412 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9c9885b4-f67d-4dde-96aa-f83fe503fa13 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:26.284875 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ba4f2a3d-ce40-41bd-825b-db0d6c4d1426 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:26.290889 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4f2a3d-ce40-41bd-825b-db0d6c4d1426 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:26.291659 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4f2a3d-ce40-41bd-825b-db0d6c4d1426 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:26.292101 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4f2a3d-ce40-41bd-825b-db0d6c4d1426 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:26.292959 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4f2a3d-ce40-41bd-825b-db0d6c4d1426 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:26.293418 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4f2a3d-ce40-41bd-825b-db0d6c4d1426 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:26.293843 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4f2a3d-ce40-41bd-825b-db0d6c4d1426 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:26.296797 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9c9885b4-f67d-4dde-96aa-f83fe503fa13 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1250 microversion: 2.1 time: 0.106824 Aug 08 14:34:26.297454 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 285/541] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:26 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1250 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:26.426725 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ba4f2a3d-ce40-41bd-825b-db0d6c4d1426 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:26.434519 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ba4f2a3d-ce40-41bd-825b-db0d6c4d1426 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.154925 Aug 08 14:34:26.435113 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 257/542] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:26 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:27.301611 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ffa4e85b-0fed-4d44-9784-19497aeab07b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:27.302262 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ffa4e85b-0fed-4d44-9784-19497aeab07b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:27.309325 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ffa4e85b-0fed-4d44-9784-19497aeab07b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:27.309801 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ffa4e85b-0fed-4d44-9784-19497aeab07b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:27.310232 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ffa4e85b-0fed-4d44-9784-19497aeab07b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:27.310914 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ffa4e85b-0fed-4d44-9784-19497aeab07b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:27.311412 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ffa4e85b-0fed-4d44-9784-19497aeab07b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:27.311856 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ffa4e85b-0fed-4d44-9784-19497aeab07b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:27.317574 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-21cf1a9e-4943-443d-a69c-8483b2b8b23a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:27.318347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-21cf1a9e-4943-443d-a69c-8483b2b8b23a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:27.324909 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-21cf1a9e-4943-443d-a69c-8483b2b8b23a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:27.325397 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-21cf1a9e-4943-443d-a69c-8483b2b8b23a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:27.325835 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-21cf1a9e-4943-443d-a69c-8483b2b8b23a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:27.326533 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-21cf1a9e-4943-443d-a69c-8483b2b8b23a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:27.326992 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-21cf1a9e-4943-443d-a69c-8483b2b8b23a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:27.327445 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-21cf1a9e-4943-443d-a69c-8483b2b8b23a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:27.330656 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=100 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:27.418962 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-21cf1a9e-4943-443d-a69c-8483b2b8b23a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:27.426487 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-21cf1a9e-4943-443d-a69c-8483b2b8b23a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1250 microversion: 2.1 time: 0.112700 Aug 08 14:34:27.426968 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 258/543] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:27 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1250 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:27.457291 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ec728455-74d9-4de5-a846-a69364620b20 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:27.458394 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ec728455-74d9-4de5-a846-a69364620b20 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:27.466464 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ec728455-74d9-4de5-a846-a69364620b20 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:27.466955 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ec728455-74d9-4de5-a846-a69364620b20 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:27.467436 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ec728455-74d9-4de5-a846-a69364620b20 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:27.468172 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ec728455-74d9-4de5-a846-a69364620b20 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:27.468623 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ec728455-74d9-4de5-a846-a69364620b20 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:27.469045 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ec728455-74d9-4de5-a846-a69364620b20 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:27.486879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ffa4e85b-0fed-4d44-9784-19497aeab07b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:27.495584 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ffa4e85b-0fed-4d44-9784-19497aeab07b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:27.497413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ffa4e85b-0fed-4d44-9784-19497aeab07b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:27.498660 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ffa4e85b-0fed-4d44-9784-19497aeab07b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1805 microversion: 2.20 time: 0.200922 Aug 08 14:34:27.499279 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 286/544] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:27 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1805 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:34:27.621714 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ec728455-74d9-4de5-a846-a69364620b20 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:27.629539 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ec728455-74d9-4de5-a846-a69364620b20 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.177221 Aug 08 14:34:27.629982 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 259/545] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:27 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:28.218771 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-333d8af8-fe84-4a19-a088-f9b1260e7b44 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:28.219302 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-333d8af8-fe84-4a19-a088-f9b1260e7b44 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:28.226420 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-333d8af8-fe84-4a19-a088-f9b1260e7b44 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:28.226967 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-333d8af8-fe84-4a19-a088-f9b1260e7b44 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:28.227434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-333d8af8-fe84-4a19-a088-f9b1260e7b44 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:28.231319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-333d8af8-fe84-4a19-a088-f9b1260e7b44 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:28.231319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-333d8af8-fe84-4a19-a088-f9b1260e7b44 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:28.231319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-333d8af8-fe84-4a19-a088-f9b1260e7b44 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:28.376497 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-333d8af8-fe84-4a19-a088-f9b1260e7b44 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lazy-loading 'services' on Instance uuid 47aa956f-cd4e-48b9-86f6-7ae42c470668 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:34:28.447463 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f087775c-a239-4cb7-bd74-373368c9799b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:28.448157 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f087775c-a239-4cb7-bd74-373368c9799b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:28.454621 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f087775c-a239-4cb7-bd74-373368c9799b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:28.455222 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f087775c-a239-4cb7-bd74-373368c9799b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:28.455762 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f087775c-a239-4cb7-bd74-373368c9799b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:28.456558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f087775c-a239-4cb7-bd74-373368c9799b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:28.457078 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f087775c-a239-4cb7-bd74-373368c9799b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:28.457572 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f087775c-a239-4cb7-bd74-373368c9799b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:28.499714 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-333d8af8-fe84-4a19-a088-f9b1260e7b44 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "DELETE /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668/os-volume_attachments/db165b2c-9a61-4a22-b582-d47b0c4f93f2" status: 202 len: 0 microversion: 2.1 time: 0.285788 Aug 08 14:34:28.500325 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 287/546] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 14:34:28 2022] DELETE /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668/os-volume_attachments/db165b2c-9a61-4a22-b582-d47b0c4f93f2 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:34:28.523280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ba6d6b9f-d73a-4c50-bd71-b959d1b5601b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:28.523992 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ba6d6b9f-d73a-4c50-bd71-b959d1b5601b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:28.524852 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f087775c-a239-4cb7-bd74-373368c9799b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:28.530785 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba6d6b9f-d73a-4c50-bd71-b959d1b5601b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:28.531351 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba6d6b9f-d73a-4c50-bd71-b959d1b5601b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:28.531766 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba6d6b9f-d73a-4c50-bd71-b959d1b5601b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:28.532475 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba6d6b9f-d73a-4c50-bd71-b959d1b5601b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:28.533215 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba6d6b9f-d73a-4c50-bd71-b959d1b5601b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:28.533753 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f087775c-a239-4cb7-bd74-373368c9799b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1304 microversion: 2.1 time: 0.090525 Aug 08 14:34:28.533882 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba6d6b9f-d73a-4c50-bd71-b959d1b5601b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:28.534696 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 260/547] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:28 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:28.650814 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e778d34a-e38a-47e7-85f0-a66fbce39079 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:28.651333 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e778d34a-e38a-47e7-85f0-a66fbce39079 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:28.659222 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e778d34a-e38a-47e7-85f0-a66fbce39079 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:28.660024 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e778d34a-e38a-47e7-85f0-a66fbce39079 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:28.660453 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e778d34a-e38a-47e7-85f0-a66fbce39079 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:28.661153 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e778d34a-e38a-47e7-85f0-a66fbce39079 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:28.662278 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e778d34a-e38a-47e7-85f0-a66fbce39079 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:28.662841 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e778d34a-e38a-47e7-85f0-a66fbce39079 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:28.692238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ba6d6b9f-d73a-4c50-bd71-b959d1b5601b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:28.701962 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ba6d6b9f-d73a-4c50-bd71-b959d1b5601b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:28.704993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ba6d6b9f-d73a-4c50-bd71-b959d1b5601b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:28.706249 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ba6d6b9f-d73a-4c50-bd71-b959d1b5601b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1792 microversion: 2.20 time: 0.188229 Aug 08 14:34:28.706832 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 288/548] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:34:28 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1792 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:34:28.820230 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e778d34a-e38a-47e7-85f0-a66fbce39079 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:28.828465 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e778d34a-e38a-47e7-85f0-a66fbce39079 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.181977 Aug 08 14:34:28.829164 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 261/549] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:28 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:29.557852 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3abf8f32-8d52-46a6-b2ca-32c90e9e21f0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:29.559311 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3abf8f32-8d52-46a6-b2ca-32c90e9e21f0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:29.566710 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3abf8f32-8d52-46a6-b2ca-32c90e9e21f0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:29.567234 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3abf8f32-8d52-46a6-b2ca-32c90e9e21f0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:29.567739 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3abf8f32-8d52-46a6-b2ca-32c90e9e21f0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:29.568636 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3abf8f32-8d52-46a6-b2ca-32c90e9e21f0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:29.569278 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3abf8f32-8d52-46a6-b2ca-32c90e9e21f0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:29.570324 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3abf8f32-8d52-46a6-b2ca-32c90e9e21f0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:29.725256 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3abf8f32-8d52-46a6-b2ca-32c90e9e21f0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:29.732949 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3abf8f32-8d52-46a6-b2ca-32c90e9e21f0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1372 microversion: 2.1 time: 0.181330 Aug 08 14:34:29.733536 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 289/550] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:29 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:29.850351 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-70f339de-bde6-4a36-a080-a443fe734afc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:29.851043 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-70f339de-bde6-4a36-a080-a443fe734afc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:29.857835 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-70f339de-bde6-4a36-a080-a443fe734afc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:29.858321 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-70f339de-bde6-4a36-a080-a443fe734afc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:29.858943 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-70f339de-bde6-4a36-a080-a443fe734afc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:29.859745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-70f339de-bde6-4a36-a080-a443fe734afc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:29.860200 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-70f339de-bde6-4a36-a080-a443fe734afc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:29.860824 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-70f339de-bde6-4a36-a080-a443fe734afc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:30.013233 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-1952ee62-782b-4e82-926e-8c4536a1849b req-a0b9549b-e5c3-4555-a1c2-3cde5059305a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8", "tag": "ecab4c77-001d-40fa-84b2-143d50377acf"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:30.020787 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-70f339de-bde6-4a36-a080-a443fe734afc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:30.031378 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-70f339de-bde6-4a36-a080-a443fe734afc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.185502 Aug 08 14:34:30.032277 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-1952ee62-782b-4e82-926e-8c4536a1849b req-a0b9549b-e5c3-4555-a1c2-3cde5059305a service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:30.047187 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 262/551] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:29 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:30.052019 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-1952ee62-782b-4e82-926e-8c4536a1849b req-a0b9549b-e5c3-4555-a1c2-3cde5059305a service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:30.053280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-1952ee62-782b-4e82-926e-8c4536a1849b req-a0b9549b-e5c3-4555-a1c2-3cde5059305a service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:30.082522 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-1952ee62-782b-4e82-926e-8c4536a1849b req-a0b9549b-e5c3-4555-a1c2-3cde5059305a service nova] Creating event network-changed:ecab4c77-001d-40fa-84b2-143d50377acf for instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 on hv-cinder-85200 Aug 08 14:34:30.094201 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-1952ee62-782b-4e82-926e-8c4536a1849b req-a0b9549b-e5c3-4555-a1c2-3cde5059305a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088814 Aug 08 14:34:30.095872 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 290/552] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:34:30.699071 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-54d483fc-1fd4-4619-be8f-bba79ff59820 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:30.699784 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-54d483fc-1fd4-4619-be8f-bba79ff59820 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:30.707222 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54d483fc-1fd4-4619-be8f-bba79ff59820 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:30.707745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54d483fc-1fd4-4619-be8f-bba79ff59820 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:30.708214 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54d483fc-1fd4-4619-be8f-bba79ff59820 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:30.708962 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54d483fc-1fd4-4619-be8f-bba79ff59820 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:30.709501 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54d483fc-1fd4-4619-be8f-bba79ff59820 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:30.709959 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54d483fc-1fd4-4619-be8f-bba79ff59820 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:30.739165 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-54d483fc-1fd4-4619-be8f-bba79ff59820 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:34:30.754332 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8e09413f-93a1-4f45-8f17-a4a1b6df8c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:30.755038 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8e09413f-93a1-4f45-8f17-a4a1b6df8c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:30.762349 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8e09413f-93a1-4f45-8f17-a4a1b6df8c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:30.762823 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8e09413f-93a1-4f45-8f17-a4a1b6df8c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:30.763295 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8e09413f-93a1-4f45-8f17-a4a1b6df8c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:30.763999 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8e09413f-93a1-4f45-8f17-a4a1b6df8c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:30.764458 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8e09413f-93a1-4f45-8f17-a4a1b6df8c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:30.764894 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8e09413f-93a1-4f45-8f17-a4a1b6df8c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:30.822930 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-54d483fc-1fd4-4619-be8f-bba79ff59820 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "DELETE /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 204 len: 0 microversion: 2.1 time: 0.127885 Aug 08 14:34:30.823556 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 263/553] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:34:30 2022] DELETE /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 14:34:30.832135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a0a61a8f-9524-41cf-ac36-6f161052e76b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:30.832866 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a0a61a8f-9524-41cf-ac36-6f161052e76b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:30.838934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0a61a8f-9524-41cf-ac36-6f161052e76b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:30.839471 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0a61a8f-9524-41cf-ac36-6f161052e76b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:30.839995 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0a61a8f-9524-41cf-ac36-6f161052e76b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:30.840617 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0a61a8f-9524-41cf-ac36-6f161052e76b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:30.841072 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0a61a8f-9524-41cf-ac36-6f161052e76b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:30.841500 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0a61a8f-9524-41cf-ac36-6f161052e76b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:30.946811 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8e09413f-93a1-4f45-8f17-a4a1b6df8c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:30.954468 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8e09413f-93a1-4f45-8f17-a4a1b6df8c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1372 microversion: 2.1 time: 0.204347 Aug 08 14:34:30.955054 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 291/554] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:30 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1372 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:30.995395 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a0a61a8f-9524-41cf-ac36-6f161052e76b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:31.002960 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a0a61a8f-9524-41cf-ac36-6f161052e76b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1513 microversion: 2.1 time: 0.174981 Aug 08 14:34:31.003561 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 264/555] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:30 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:31.069241 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-eb08f236-b85f-4013-b27e-127949750259 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:31.069853 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-eb08f236-b85f-4013-b27e-127949750259 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:31.075927 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb08f236-b85f-4013-b27e-127949750259 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:31.076413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb08f236-b85f-4013-b27e-127949750259 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:31.076850 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb08f236-b85f-4013-b27e-127949750259 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:31.077537 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb08f236-b85f-4013-b27e-127949750259 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:31.077991 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb08f236-b85f-4013-b27e-127949750259 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:31.078417 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb08f236-b85f-4013-b27e-127949750259 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:31.213030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-eb08f236-b85f-4013-b27e-127949750259 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:31.220888 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-eb08f236-b85f-4013-b27e-127949750259 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.155480 Aug 08 14:34:31.221583 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 292/556] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:31 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:31.975234 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-203e08ce-20be-4064-8913-01718a9962ea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:31.975876 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-203e08ce-20be-4064-8913-01718a9962ea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:31.982343 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-203e08ce-20be-4064-8913-01718a9962ea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:31.982831 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-203e08ce-20be-4064-8913-01718a9962ea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:31.983309 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-203e08ce-20be-4064-8913-01718a9962ea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:31.984015 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-203e08ce-20be-4064-8913-01718a9962ea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:31.984550 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-203e08ce-20be-4064-8913-01718a9962ea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:31.984933 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-203e08ce-20be-4064-8913-01718a9962ea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:32.024174 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bf7f1919-f165-4c3e-a2a7-e87af2d9d379 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:32.027649 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bf7f1919-f165-4c3e-a2a7-e87af2d9d379 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:32.031891 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bf7f1919-f165-4c3e-a2a7-e87af2d9d379 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:32.032474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bf7f1919-f165-4c3e-a2a7-e87af2d9d379 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:32.033366 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bf7f1919-f165-4c3e-a2a7-e87af2d9d379 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:32.034475 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bf7f1919-f165-4c3e-a2a7-e87af2d9d379 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:32.034941 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bf7f1919-f165-4c3e-a2a7-e87af2d9d379 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:32.035406 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bf7f1919-f165-4c3e-a2a7-e87af2d9d379 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:32.182242 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-203e08ce-20be-4064-8913-01718a9962ea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:32.190147 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-203e08ce-20be-4064-8913-01718a9962ea tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1372 microversion: 2.1 time: 0.218825 Aug 08 14:34:32.190912 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 265/557] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:31 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:32.209198 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bf7f1919-f165-4c3e-a2a7-e87af2d9d379 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:32.216951 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bf7f1919-f165-4c3e-a2a7-e87af2d9d379 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1513 microversion: 2.1 time: 0.196819 Aug 08 14:34:32.217535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 293/558] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:32 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:32.245370 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e4a7b841-4c79-4e8b-a375-a9a9ee7b38f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:32.245979 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e4a7b841-4c79-4e8b-a375-a9a9ee7b38f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:32.252036 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e4a7b841-4c79-4e8b-a375-a9a9ee7b38f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:32.252521 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e4a7b841-4c79-4e8b-a375-a9a9ee7b38f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:32.252955 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e4a7b841-4c79-4e8b-a375-a9a9ee7b38f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:32.253649 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e4a7b841-4c79-4e8b-a375-a9a9ee7b38f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:32.254102 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e4a7b841-4c79-4e8b-a375-a9a9ee7b38f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:32.254527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e4a7b841-4c79-4e8b-a375-a9a9ee7b38f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:32.391232 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e4a7b841-4c79-4e8b-a375-a9a9ee7b38f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:32.399246 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e4a7b841-4c79-4e8b-a375-a9a9ee7b38f7 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.157696 Aug 08 14:34:32.399824 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 266/559] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:32 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:33.211228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f5238357-aed5-4b90-9fcb-a20b429cd453 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:33.211789 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f5238357-aed5-4b90-9fcb-a20b429cd453 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:33.219054 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f5238357-aed5-4b90-9fcb-a20b429cd453 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:33.219566 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f5238357-aed5-4b90-9fcb-a20b429cd453 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:33.219997 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f5238357-aed5-4b90-9fcb-a20b429cd453 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:33.220688 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f5238357-aed5-4b90-9fcb-a20b429cd453 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:33.221137 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f5238357-aed5-4b90-9fcb-a20b429cd453 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:33.221553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f5238357-aed5-4b90-9fcb-a20b429cd453 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:33.237810 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3420dd55-7093-44a2-82f1-d41a771ed084 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:33.238411 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3420dd55-7093-44a2-82f1-d41a771ed084 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:33.244707 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3420dd55-7093-44a2-82f1-d41a771ed084 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:33.245189 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3420dd55-7093-44a2-82f1-d41a771ed084 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:33.245625 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3420dd55-7093-44a2-82f1-d41a771ed084 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:33.246318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3420dd55-7093-44a2-82f1-d41a771ed084 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:33.246772 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3420dd55-7093-44a2-82f1-d41a771ed084 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:33.247224 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3420dd55-7093-44a2-82f1-d41a771ed084 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:33.423699 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f5238357-aed5-4b90-9fcb-a20b429cd453 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:33.429187 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3420dd55-7093-44a2-82f1-d41a771ed084 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:33.431978 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f5238357-aed5-4b90-9fcb-a20b429cd453 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1372 microversion: 2.1 time: 0.225260 Aug 08 14:34:33.432564 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 294/560] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:33 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1372 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:33.437017 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-fcad007c-a246-4d25-b594-242b742ef1e5 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:33.437622 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-fcad007c-a246-4d25-b594-242b742ef1e5 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:33.437982 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3420dd55-7093-44a2-82f1-d41a771ed084 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1513 microversion: 2.1 time: 0.203955 Aug 08 14:34:33.438741 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 267/561] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:33 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:33.444717 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fcad007c-a246-4d25-b594-242b742ef1e5 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:33.445206 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fcad007c-a246-4d25-b594-242b742ef1e5 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:33.445642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fcad007c-a246-4d25-b594-242b742ef1e5 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:33.446342 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fcad007c-a246-4d25-b594-242b742ef1e5 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:33.446792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fcad007c-a246-4d25-b594-242b742ef1e5 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:33.447241 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fcad007c-a246-4d25-b594-242b742ef1e5 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:33.584010 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-fcad007c-a246-4d25-b594-242b742ef1e5 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:33.591482 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-fcad007c-a246-4d25-b594-242b742ef1e5 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.157955 Aug 08 14:34:33.592047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 295/562] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:33 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:34.453301 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9693a24f-cdce-483b-ac60-2aee87e799c8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:34.453903 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9693a24f-cdce-483b-ac60-2aee87e799c8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:34.461110 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9693a24f-cdce-483b-ac60-2aee87e799c8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:34.461267 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6deee27e-9e36-4de9-8995-f2efc444c5b8 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:34.461698 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9693a24f-cdce-483b-ac60-2aee87e799c8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:34.461886 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6deee27e-9e36-4de9-8995-f2efc444c5b8 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:34.462007 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9693a24f-cdce-483b-ac60-2aee87e799c8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:34.462697 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9693a24f-cdce-483b-ac60-2aee87e799c8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:34.463176 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9693a24f-cdce-483b-ac60-2aee87e799c8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:34.463599 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9693a24f-cdce-483b-ac60-2aee87e799c8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:34.468076 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6deee27e-9e36-4de9-8995-f2efc444c5b8 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:34.468575 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6deee27e-9e36-4de9-8995-f2efc444c5b8 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:34.468937 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6deee27e-9e36-4de9-8995-f2efc444c5b8 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:34.469640 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6deee27e-9e36-4de9-8995-f2efc444c5b8 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:34.470105 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6deee27e-9e36-4de9-8995-f2efc444c5b8 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:34.470526 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6deee27e-9e36-4de9-8995-f2efc444c5b8 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:34.663746 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9693a24f-cdce-483b-ac60-2aee87e799c8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:34.667130 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6deee27e-9e36-4de9-8995-f2efc444c5b8 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:34.671671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9693a24f-cdce-483b-ac60-2aee87e799c8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1372 microversion: 2.1 time: 0.222234 Aug 08 14:34:34.672315 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 268/563] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:34 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:34.683267 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6deee27e-9e36-4de9-8995-f2efc444c5b8 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1513 microversion: 2.1 time: 0.217831 Aug 08 14:34:34.683267 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 296/564] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:34 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:34.683498 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d2397e18-c5ab-485f-acf5-b12fe18c4789 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:34.683498 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d2397e18-c5ab-485f-acf5-b12fe18c4789 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:34.686712 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d2397e18-c5ab-485f-acf5-b12fe18c4789 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:34.687243 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d2397e18-c5ab-485f-acf5-b12fe18c4789 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:34.693090 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d2397e18-c5ab-485f-acf5-b12fe18c4789 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:34.693090 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d2397e18-c5ab-485f-acf5-b12fe18c4789 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:34.693090 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d2397e18-c5ab-485f-acf5-b12fe18c4789 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:34.693090 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d2397e18-c5ab-485f-acf5-b12fe18c4789 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:34.824541 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d2397e18-c5ab-485f-acf5-b12fe18c4789 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:34.831976 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d2397e18-c5ab-485f-acf5-b12fe18c4789 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.155775 Aug 08 14:34:34.832536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 269/565] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:34 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:35.693459 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5128048d-93aa-4ad1-96b3-70882656084d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:35.694062 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5128048d-93aa-4ad1-96b3-70882656084d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:35.695234 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7278f109-8403-4a02-b6a4-18fbdf01222b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:35.695834 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7278f109-8403-4a02-b6a4-18fbdf01222b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:35.696070 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:35.696713 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=6 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:35.698329 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=6 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:35.703304 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5128048d-93aa-4ad1-96b3-70882656084d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:35.703793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5128048d-93aa-4ad1-96b3-70882656084d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:35.704227 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5128048d-93aa-4ad1-96b3-70882656084d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:35.704925 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5128048d-93aa-4ad1-96b3-70882656084d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:35.705240 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7278f109-8403-4a02-b6a4-18fbdf01222b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:35.705379 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5128048d-93aa-4ad1-96b3-70882656084d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:35.705726 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7278f109-8403-4a02-b6a4-18fbdf01222b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:35.705824 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5128048d-93aa-4ad1-96b3-70882656084d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:35.706192 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7278f109-8403-4a02-b6a4-18fbdf01222b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:35.706914 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7278f109-8403-4a02-b6a4-18fbdf01222b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:35.707389 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7278f109-8403-4a02-b6a4-18fbdf01222b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:35.707813 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7278f109-8403-4a02-b6a4-18fbdf01222b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:35.726893 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:35.901693 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5128048d-93aa-4ad1-96b3-70882656084d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:35.905331 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7278f109-8403-4a02-b6a4-18fbdf01222b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:35.909353 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5128048d-93aa-4ad1-96b3-70882656084d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1372 microversion: 2.1 time: 0.219871 Aug 08 14:34:35.909940 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 297/566] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:35 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:35.923262 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7278f109-8403-4a02-b6a4-18fbdf01222b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1513 microversion: 2.1 time: 0.222878 Aug 08 14:34:35.923411 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f9486a17-7e33-4391-832a-4a850c42eaca tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:35.923411 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f9486a17-7e33-4391-832a-4a850c42eaca tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:35.923411 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f9486a17-7e33-4391-832a-4a850c42eaca tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:35.923411 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f9486a17-7e33-4391-832a-4a850c42eaca tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:35.923725 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f9486a17-7e33-4391-832a-4a850c42eaca tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:35.923725 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f9486a17-7e33-4391-832a-4a850c42eaca tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:35.923889 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f9486a17-7e33-4391-832a-4a850c42eaca tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:35.924171 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 270/567] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:35 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:35.924306 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f9486a17-7e33-4391-832a-4a850c42eaca tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:36.063389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f9486a17-7e33-4391-832a-4a850c42eaca tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:36.071376 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f9486a17-7e33-4391-832a-4a850c42eaca tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.160450 Aug 08 14:34:36.071948 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 298/568] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:35 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:36.931888 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-844a36d7-48f2-4544-9d5e-34598aef8450 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:36.932738 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-844a36d7-48f2-4544-9d5e-34598aef8450 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:36.936020 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-817d8659-0b95-400c-b11b-fa45fa43dd66 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:36.936700 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-817d8659-0b95-400c-b11b-fa45fa43dd66 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:36.939796 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-844a36d7-48f2-4544-9d5e-34598aef8450 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:36.940378 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-844a36d7-48f2-4544-9d5e-34598aef8450 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:36.940733 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-844a36d7-48f2-4544-9d5e-34598aef8450 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:36.941458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-844a36d7-48f2-4544-9d5e-34598aef8450 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:36.941915 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-844a36d7-48f2-4544-9d5e-34598aef8450 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:36.942343 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-844a36d7-48f2-4544-9d5e-34598aef8450 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:36.943369 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-817d8659-0b95-400c-b11b-fa45fa43dd66 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:36.943858 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-817d8659-0b95-400c-b11b-fa45fa43dd66 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:36.944315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-817d8659-0b95-400c-b11b-fa45fa43dd66 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:36.944993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-817d8659-0b95-400c-b11b-fa45fa43dd66 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:36.945444 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-817d8659-0b95-400c-b11b-fa45fa43dd66 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:36.945875 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-817d8659-0b95-400c-b11b-fa45fa43dd66 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:37.419394 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-817d8659-0b95-400c-b11b-fa45fa43dd66 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:37.423804 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-844a36d7-48f2-4544-9d5e-34598aef8450 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:37.427026 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-817d8659-0b95-400c-b11b-fa45fa43dd66 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1513 microversion: 2.1 time: 0.494918 Aug 08 14:34:37.427634 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 299/569] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:36 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1513 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:34:37.432096 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bab3bbde-862f-4fb5-8876-0d2db38881c3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:37.432800 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bab3bbde-862f-4fb5-8876-0d2db38881c3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:37.435367 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-844a36d7-48f2-4544-9d5e-34598aef8450 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1372 microversion: 2.1 time: 0.508929 Aug 08 14:34:37.436209 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 271/570] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:36 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1372 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:37.438814 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bab3bbde-862f-4fb5-8876-0d2db38881c3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:37.439320 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bab3bbde-862f-4fb5-8876-0d2db38881c3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:37.439899 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bab3bbde-862f-4fb5-8876-0d2db38881c3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:37.440726 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bab3bbde-862f-4fb5-8876-0d2db38881c3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:37.441321 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bab3bbde-862f-4fb5-8876-0d2db38881c3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:37.441920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bab3bbde-862f-4fb5-8876-0d2db38881c3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:37.577620 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bab3bbde-862f-4fb5-8876-0d2db38881c3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:37.589295 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bab3bbde-862f-4fb5-8876-0d2db38881c3 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.160578 Aug 08 14:34:37.590111 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 300/571] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:37 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:38.295156 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-5ed4ab55-8359-40cf-980e-40b9b791fb7a req-0c3f3895-7b81-488b-8ff2-d33c9f4711f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8", "name": "network-vif-plugged", "status": "completed", "tag": "ecab4c77-001d-40fa-84b2-143d50377acf"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:38.338812 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-5ed4ab55-8359-40cf-980e-40b9b791fb7a req-0c3f3895-7b81-488b-8ff2-d33c9f4711f9 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:38.339533 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-5ed4ab55-8359-40cf-980e-40b9b791fb7a req-0c3f3895-7b81-488b-8ff2-d33c9f4711f9 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:38.341997 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-5ed4ab55-8359-40cf-980e-40b9b791fb7a req-0c3f3895-7b81-488b-8ff2-d33c9f4711f9 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:38.360236 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-5ed4ab55-8359-40cf-980e-40b9b791fb7a req-0c3f3895-7b81-488b-8ff2-d33c9f4711f9 service nova] Creating event network-vif-plugged:ecab4c77-001d-40fa-84b2-143d50377acf for instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 on hv-cinder-85200 Aug 08 14:34:38.367704 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-5ed4ab55-8359-40cf-980e-40b9b791fb7a req-0c3f3895-7b81-488b-8ff2-d33c9f4711f9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079519 Aug 08 14:34:38.369069 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 272/572] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:34:38.452369 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c340c09d-ea1f-4a15-a10b-334e57fdd1d7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:38.454732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c340c09d-ea1f-4a15-a10b-334e57fdd1d7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:38.457961 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4c83eec1-61c9-408f-86e5-dfc0bc92654d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:38.458979 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4c83eec1-61c9-408f-86e5-dfc0bc92654d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:38.469910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c340c09d-ea1f-4a15-a10b-334e57fdd1d7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:38.470408 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c340c09d-ea1f-4a15-a10b-334e57fdd1d7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:38.471348 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c83eec1-61c9-408f-86e5-dfc0bc92654d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:38.472879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c340c09d-ea1f-4a15-a10b-334e57fdd1d7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:38.473207 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c83eec1-61c9-408f-86e5-dfc0bc92654d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:38.474240 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c340c09d-ea1f-4a15-a10b-334e57fdd1d7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:38.474365 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c83eec1-61c9-408f-86e5-dfc0bc92654d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:38.474725 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c340c09d-ea1f-4a15-a10b-334e57fdd1d7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:38.476377 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c340c09d-ea1f-4a15-a10b-334e57fdd1d7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:38.488377 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c83eec1-61c9-408f-86e5-dfc0bc92654d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:38.489099 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c83eec1-61c9-408f-86e5-dfc0bc92654d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:38.490325 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c83eec1-61c9-408f-86e5-dfc0bc92654d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:38.594029 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c340c09d-ea1f-4a15-a10b-334e57fdd1d7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:38.603957 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c340c09d-ea1f-4a15-a10b-334e57fdd1d7 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1471 microversion: 2.1 time: 0.158754 Aug 08 14:34:38.605069 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 301/573] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:38 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:38.617967 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9dfd3050-0305-4b62-9c10-f65278dd9918 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:38.619062 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9dfd3050-0305-4b62-9c10-f65278dd9918 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:38.631261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9dfd3050-0305-4b62-9c10-f65278dd9918 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:38.631868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9dfd3050-0305-4b62-9c10-f65278dd9918 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:38.632380 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9dfd3050-0305-4b62-9c10-f65278dd9918 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:38.633319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9dfd3050-0305-4b62-9c10-f65278dd9918 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:38.634313 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9dfd3050-0305-4b62-9c10-f65278dd9918 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:38.634313 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9dfd3050-0305-4b62-9c10-f65278dd9918 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:38.682526 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4c83eec1-61c9-408f-86e5-dfc0bc92654d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:38.693838 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4c83eec1-61c9-408f-86e5-dfc0bc92654d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1372 microversion: 2.1 time: 0.240582 Aug 08 14:34:38.695076 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 273/574] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:38 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1372 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:38.704041 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-6af52926-8418-477f-af11-01305c2409e2 req-3d73ebb5-4431-4582-aff9-c779787f8795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47aa956f-cd4e-48b9-86f6-7ae42c470668", "name": "network-vif-deleted", "tag": "be0f3565-2c11-49fe-9a87-e9ac3e0a83fe"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:38.729060 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-6af52926-8418-477f-af11-01305c2409e2 req-3d73ebb5-4431-4582-aff9-c779787f8795 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:38.730171 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-6af52926-8418-477f-af11-01305c2409e2 req-3d73ebb5-4431-4582-aff9-c779787f8795 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:38.731294 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-6af52926-8418-477f-af11-01305c2409e2 req-3d73ebb5-4431-4582-aff9-c779787f8795 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:38.764645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-6af52926-8418-477f-af11-01305c2409e2 req-3d73ebb5-4431-4582-aff9-c779787f8795 service nova] Creating event network-vif-deleted:be0f3565-2c11-49fe-9a87-e9ac3e0a83fe for instance 47aa956f-cd4e-48b9-86f6-7ae42c470668 on hv-cinder-85200 Aug 08 14:34:38.774262 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-6af52926-8418-477f-af11-01305c2409e2 req-3d73ebb5-4431-4582-aff9-c779787f8795 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076999 Aug 08 14:34:38.775382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 274/575] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:34:38.822281 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9dfd3050-0305-4b62-9c10-f65278dd9918 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:38.830062 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9dfd3050-0305-4b62-9c10-f65278dd9918 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.220171 Aug 08 14:34:38.830628 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 302/576] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:38 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:39.631744 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bbca54b8-037d-4489-865a-02c670347855 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:39.632440 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bbca54b8-037d-4489-865a-02c670347855 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:39.638640 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bbca54b8-037d-4489-865a-02c670347855 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:39.639234 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bbca54b8-037d-4489-865a-02c670347855 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:39.639591 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bbca54b8-037d-4489-865a-02c670347855 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:39.640307 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bbca54b8-037d-4489-865a-02c670347855 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:39.640756 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bbca54b8-037d-4489-865a-02c670347855 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:39.641177 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bbca54b8-037d-4489-865a-02c670347855 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:39.671556 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bbca54b8-037d-4489-865a-02c670347855 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:39.672036 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bbca54b8-037d-4489-865a-02c670347855 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:39.672467 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bbca54b8-037d-4489-865a-02c670347855 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:39.672912 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-bbca54b8-037d-4489-865a-02c670347855 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lazy-loading 'fault' on Instance uuid 47aa956f-cd4e-48b9-86f6-7ae42c470668 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:34:39.718358 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bbca54b8-037d-4489-865a-02c670347855 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:39.725643 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-25b0a14c-0bbd-4c71-9c2e-dd382b630c5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:39.726247 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-25b0a14c-0bbd-4c71-9c2e-dd382b630c5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:39.731044 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bbca54b8-037d-4489-865a-02c670347855 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 200 len: 1308 microversion: 2.1 time: 0.104775 Aug 08 14:34:39.731665 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 275/577] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:39 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:39.732550 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-25b0a14c-0bbd-4c71-9c2e-dd382b630c5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:39.733030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-25b0a14c-0bbd-4c71-9c2e-dd382b630c5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:39.733460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-25b0a14c-0bbd-4c71-9c2e-dd382b630c5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:39.734148 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-25b0a14c-0bbd-4c71-9c2e-dd382b630c5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:39.734597 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-25b0a14c-0bbd-4c71-9c2e-dd382b630c5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:39.735016 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-25b0a14c-0bbd-4c71-9c2e-dd382b630c5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:39.740026 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:39.852280 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c678edb8-f3f7-4646-99b0-7ce6df31efe6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:39.853037 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c678edb8-f3f7-4646-99b0-7ce6df31efe6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:39.861080 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c678edb8-f3f7-4646-99b0-7ce6df31efe6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:39.861621 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c678edb8-f3f7-4646-99b0-7ce6df31efe6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:39.862011 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c678edb8-f3f7-4646-99b0-7ce6df31efe6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:39.862914 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c678edb8-f3f7-4646-99b0-7ce6df31efe6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:39.863800 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c678edb8-f3f7-4646-99b0-7ce6df31efe6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:39.864225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c678edb8-f3f7-4646-99b0-7ce6df31efe6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:39.870318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-25b0a14c-0bbd-4c71-9c2e-dd382b630c5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:39.878096 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-25b0a14c-0bbd-4c71-9c2e-dd382b630c5f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1372 microversion: 2.1 time: 0.156202 Aug 08 14:34:39.878873 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 303/578] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:39 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:40.000391 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c678edb8-f3f7-4646-99b0-7ce6df31efe6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:40.009401 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c678edb8-f3f7-4646-99b0-7ce6df31efe6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.162016 Aug 08 14:34:40.010044 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 276/579] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:39 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:40.753201 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-01c33a84-746c-4cfc-9c23-749e8f56e5af tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:40.753842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-01c33a84-746c-4cfc-9c23-749e8f56e5af tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 47aa956f-cd4e-48b9-86f6-7ae42c470668] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:40.756909 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:40.762186 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-01c33a84-746c-4cfc-9c23-749e8f56e5af tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:40.762680 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-01c33a84-746c-4cfc-9c23-749e8f56e5af tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:40.763140 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-01c33a84-746c-4cfc-9c23-749e8f56e5af tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:40.763848 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-01c33a84-746c-4cfc-9c23-749e8f56e5af tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:40.764302 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-01c33a84-746c-4cfc-9c23-749e8f56e5af tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:40.764768 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-01c33a84-746c-4cfc-9c23-749e8f56e5af tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:40.779690 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-01c33a84-746c-4cfc-9c23-749e8f56e5af tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] HTTP exception thrown: Instance 47aa956f-cd4e-48b9-86f6-7ae42c470668 could not be found. Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-01c33a84-746c-4cfc-9c23-749e8f56e5af tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Request method failure captured: Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 HTTP/1.1 Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R6X8HzSCKcEAD0mIYWiIURNB8GnpLaLUhczqTn-MyUqt8b1OSNLzBxt-1Z5EDIuZr3TcNd1ngVCerFhjK8UFw2VdbgR2rE73qHB4TD63bY5u4eRNcfWskNM4wPF6j5V9FNUb9MAKFC0gUQOJb49mNKA6lBGcNqPYC-hzMPUSjy_NDM Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 693b1fece5b548c786a495d2dc91bd8a Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1757663352 Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:34:40.781474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:34:40.783047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/693b1fece5b548c786a495d2dc91bd8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_693b1fece5b548c786a495d2dc91bd8a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/693b1fece5b548c786a495d2dc91bd8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/693b1fece5b548c786a495d2dc91bd8a"}]}] Aug 08 14:34:40.783047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-VolumesSnapshotTestJSON-1757663352 Aug 08 14:34:40.783047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 693b1fece5b548c786a495d2dc91bd8a Aug 08 14:34:40.783047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1757663352 Aug 08 14:34:40.783047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-VolumesSnapshotTestJSON-1757663352-project Aug 08 14:34:40.783047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:34:40.783047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:34:40.783047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 57e1243ffa724189ba7d2b9277e10afd Aug 08 14:34:40.783047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-VolumesSnapshotTestJSON-1757663352-project Aug 08 14:34:40.783047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:34:40.783047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance 47aa956f-cd4e-48b9-86f6-7ae42c470668 could not be found. Aug 08 14:34:40.783047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': '47aa956f-cd4e-48b9-86f6-7ae42c470668'} Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47aa956f-cd4e-48b9-86f6-7ae42c470668 could not be found. Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:34:40.783931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47aa956f-cd4e-48b9-86f6-7ae42c470668 could not be found. Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47aa956f-cd4e-48b9-86f6-7ae42c470668 could not be found. Aug 08 14:34:40.785123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:34:40.786167 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-01c33a84-746c-4cfc-9c23-749e8f56e5af tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Returning 404 to user: Instance 47aa956f-cd4e-48b9-86f6-7ae42c470668 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:34:40.786167 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-01c33a84-746c-4cfc-9c23-749e8f56e5af tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668" status: 404 len: 111 microversion: 2.1 time: 0.033679 Aug 08 14:34:40.786167 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 304/580] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:40 2022] GET /compute/v2.1/servers/47aa956f-cd4e-48b9-86f6-7ae42c470668 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:34:40.900802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1ae498cd-43f4-4563-9a22-a2a3eff71e2f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:40.902375 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1ae498cd-43f4-4563-9a22-a2a3eff71e2f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:40.909425 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ae498cd-43f4-4563-9a22-a2a3eff71e2f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:40.910111 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ae498cd-43f4-4563-9a22-a2a3eff71e2f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:40.910647 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ae498cd-43f4-4563-9a22-a2a3eff71e2f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:40.911842 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ae498cd-43f4-4563-9a22-a2a3eff71e2f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:40.912471 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ae498cd-43f4-4563-9a22-a2a3eff71e2f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:40.912902 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1ae498cd-43f4-4563-9a22-a2a3eff71e2f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:41.035417 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8c74e7ea-2c34-4a5e-97de-e9734ab9430e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:41.037662 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8c74e7ea-2c34-4a5e-97de-e9734ab9430e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:41.050398 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8c74e7ea-2c34-4a5e-97de-e9734ab9430e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:41.052522 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8c74e7ea-2c34-4a5e-97de-e9734ab9430e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:41.053646 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8c74e7ea-2c34-4a5e-97de-e9734ab9430e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:41.055302 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8c74e7ea-2c34-4a5e-97de-e9734ab9430e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:41.056469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8c74e7ea-2c34-4a5e-97de-e9734ab9430e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:41.057622 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8c74e7ea-2c34-4a5e-97de-e9734ab9430e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:41.099970 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1ae498cd-43f4-4563-9a22-a2a3eff71e2f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:41.108785 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1ae498cd-43f4-4563-9a22-a2a3eff71e2f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1566 microversion: 2.1 time: 0.213314 Aug 08 14:34:41.115366 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 277/581] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:40 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:41.131618 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3b46abb3-55b8-472b-8fbc-2a38b0e0e1f3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:41.131931 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3b46abb3-55b8-472b-8fbc-2a38b0e0e1f3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:41.138755 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b46abb3-55b8-472b-8fbc-2a38b0e0e1f3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:41.139287 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b46abb3-55b8-472b-8fbc-2a38b0e0e1f3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:41.139724 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b46abb3-55b8-472b-8fbc-2a38b0e0e1f3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:41.140434 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b46abb3-55b8-472b-8fbc-2a38b0e0e1f3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:41.140962 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b46abb3-55b8-472b-8fbc-2a38b0e0e1f3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:41.141457 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b46abb3-55b8-472b-8fbc-2a38b0e0e1f3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:41.248805 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3b46abb3-55b8-472b-8fbc-2a38b0e0e1f3 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122383 Aug 08 14:34:41.249441 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 278/582] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 14:34:41 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:34:41.264508 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8c74e7ea-2c34-4a5e-97de-e9734ab9430e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:41.272535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8c74e7ea-2c34-4a5e-97de-e9734ab9430e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.245091 Aug 08 14:34:41.273109 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 305/583] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:41 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:42.245827 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-7704fc82-aba0-465b-b467-054ad4755f3d req-9d3d1bbb-1db7-4b2d-a75b-a1e53b032a75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8", "tag": "ecab4c77-001d-40fa-84b2-143d50377acf"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:42.259396 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-7704fc82-aba0-465b-b467-054ad4755f3d req-9d3d1bbb-1db7-4b2d-a75b-a1e53b032a75 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:42.260218 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-7704fc82-aba0-465b-b467-054ad4755f3d req-9d3d1bbb-1db7-4b2d-a75b-a1e53b032a75 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:42.260826 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-7704fc82-aba0-465b-b467-054ad4755f3d req-9d3d1bbb-1db7-4b2d-a75b-a1e53b032a75 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:42.273480 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-7704fc82-aba0-465b-b467-054ad4755f3d req-9d3d1bbb-1db7-4b2d-a75b-a1e53b032a75 service nova] Creating event network-changed:ecab4c77-001d-40fa-84b2-143d50377acf for instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 on hv-cinder-85200 Aug 08 14:34:42.278520 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-7704fc82-aba0-465b-b467-054ad4755f3d req-9d3d1bbb-1db7-4b2d-a75b-a1e53b032a75 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038626 Aug 08 14:34:42.279148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 279/584] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:34:42.293376 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-90c163c4-b935-478e-b800-afbf9d573c5e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:42.294002 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-90c163c4-b935-478e-b800-afbf9d573c5e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:42.301058 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90c163c4-b935-478e-b800-afbf9d573c5e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:42.301558 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90c163c4-b935-478e-b800-afbf9d573c5e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:42.302036 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90c163c4-b935-478e-b800-afbf9d573c5e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:42.302889 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90c163c4-b935-478e-b800-afbf9d573c5e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:42.303399 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90c163c4-b935-478e-b800-afbf9d573c5e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:42.303826 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90c163c4-b935-478e-b800-afbf9d573c5e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:42.463616 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-90c163c4-b935-478e-b800-afbf9d573c5e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:42.472288 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-90c163c4-b935-478e-b800-afbf9d573c5e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.183218 Aug 08 14:34:42.473256 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 306/585] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:42 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:43.496266 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5f60a8bf-eeb0-4b4c-8014-f2a292b3c218 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:43.497134 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5f60a8bf-eeb0-4b4c-8014-f2a292b3c218 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:43.503656 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:34:43.506124 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f60a8bf-eeb0-4b4c-8014-f2a292b3c218 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:43.506922 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f60a8bf-eeb0-4b4c-8014-f2a292b3c218 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:43.507778 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f60a8bf-eeb0-4b4c-8014-f2a292b3c218 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:43.508869 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f60a8bf-eeb0-4b4c-8014-f2a292b3c218 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:43.509805 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f60a8bf-eeb0-4b4c-8014-f2a292b3c218 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:43.510832 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f60a8bf-eeb0-4b4c-8014-f2a292b3c218 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:43.671468 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5f60a8bf-eeb0-4b4c-8014-f2a292b3c218 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:43.684934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5f60a8bf-eeb0-4b4c-8014-f2a292b3c218 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.194385 Aug 08 14:34:43.692069 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 280/586] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:43 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:44.710561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-babdc461-c8d6-4480-a652-faaf301f02b1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:44.711504 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-babdc461-c8d6-4480-a652-faaf301f02b1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:44.717969 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-babdc461-c8d6-4480-a652-faaf301f02b1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:44.718484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-babdc461-c8d6-4480-a652-faaf301f02b1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:44.718928 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-babdc461-c8d6-4480-a652-faaf301f02b1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:44.719676 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-babdc461-c8d6-4480-a652-faaf301f02b1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:44.720135 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-babdc461-c8d6-4480-a652-faaf301f02b1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:44.720663 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-babdc461-c8d6-4480-a652-faaf301f02b1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:44.867625 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-babdc461-c8d6-4480-a652-faaf301f02b1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:44.875468 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-babdc461-c8d6-4480-a652-faaf301f02b1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.170621 Aug 08 14:34:44.887593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 307/587] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:44 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:44.984444 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-2d50847f-8f58-4026-bbee-3c3ed394fe7d req-25e44fff-6ab1-49f5-9ef5-a4a2c7a4e30a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eff17af-e081-4582-82fb-ba2f7a45c338", "name": "network-vif-plugged", "status": "completed", "tag": "54289b72-3379-4dba-9ae7-835b040e581b"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:44.996195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2d50847f-8f58-4026-bbee-3c3ed394fe7d req-25e44fff-6ab1-49f5-9ef5-a4a2c7a4e30a service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:44.996666 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2d50847f-8f58-4026-bbee-3c3ed394fe7d req-25e44fff-6ab1-49f5-9ef5-a4a2c7a4e30a service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:44.997089 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2d50847f-8f58-4026-bbee-3c3ed394fe7d req-25e44fff-6ab1-49f5-9ef5-a4a2c7a4e30a service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:45.010244 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-2d50847f-8f58-4026-bbee-3c3ed394fe7d req-25e44fff-6ab1-49f5-9ef5-a4a2c7a4e30a service nova] Creating event network-vif-plugged:54289b72-3379-4dba-9ae7-835b040e581b for instance 0eff17af-e081-4582-82fb-ba2f7a45c338 on hv-cinder-85200 Aug 08 14:34:45.015206 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-2d50847f-8f58-4026-bbee-3c3ed394fe7d req-25e44fff-6ab1-49f5-9ef5-a4a2c7a4e30a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035549 Aug 08 14:34:45.015990 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 281/588] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:34:45.895654 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-17ed5879-1183-4317-acca-b3101c0b74db tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:45.896351 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-17ed5879-1183-4317-acca-b3101c0b74db tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:45.903576 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-17ed5879-1183-4317-acca-b3101c0b74db tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:45.904146 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-17ed5879-1183-4317-acca-b3101c0b74db tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:45.904684 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-17ed5879-1183-4317-acca-b3101c0b74db tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:45.905383 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-17ed5879-1183-4317-acca-b3101c0b74db tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:45.905837 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-17ed5879-1183-4317-acca-b3101c0b74db tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:45.906255 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-17ed5879-1183-4317-acca-b3101c0b74db tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:46.038149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-17ed5879-1183-4317-acca-b3101c0b74db tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:46.046025 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-17ed5879-1183-4317-acca-b3101c0b74db tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.154567 Aug 08 14:34:46.046630 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 308/589] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:45 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:47.068206 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-783ffb16-cb31-4fcb-86fe-7fe2249b4877 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:47.068925 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-783ffb16-cb31-4fcb-86fe-7fe2249b4877 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:47.076133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-783ffb16-cb31-4fcb-86fe-7fe2249b4877 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:47.076616 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-783ffb16-cb31-4fcb-86fe-7fe2249b4877 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:47.077048 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-783ffb16-cb31-4fcb-86fe-7fe2249b4877 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:47.077753 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-783ffb16-cb31-4fcb-86fe-7fe2249b4877 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:47.078217 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-783ffb16-cb31-4fcb-86fe-7fe2249b4877 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:47.078624 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-783ffb16-cb31-4fcb-86fe-7fe2249b4877 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:47.214868 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-783ffb16-cb31-4fcb-86fe-7fe2249b4877 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:47.222380 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-783ffb16-cb31-4fcb-86fe-7fe2249b4877 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.159021 Aug 08 14:34:47.222953 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 282/590] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:47 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:48.243045 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e1591b56-5842-4da0-9a08-20a4515c8c66 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:48.243590 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e1591b56-5842-4da0-9a08-20a4515c8c66 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:48.250056 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e1591b56-5842-4da0-9a08-20a4515c8c66 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:48.250540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e1591b56-5842-4da0-9a08-20a4515c8c66 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:48.250981 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e1591b56-5842-4da0-9a08-20a4515c8c66 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:48.251710 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e1591b56-5842-4da0-9a08-20a4515c8c66 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:48.252166 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e1591b56-5842-4da0-9a08-20a4515c8c66 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:48.252591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e1591b56-5842-4da0-9a08-20a4515c8c66 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:48.388124 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e1591b56-5842-4da0-9a08-20a4515c8c66 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:48.396255 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e1591b56-5842-4da0-9a08-20a4515c8c66 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.156575 Aug 08 14:34:48.396820 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 309/591] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:48 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:49.417740 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9b2cccea-fe65-4ba7-8044-a0b38ac85c54 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:49.418349 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9b2cccea-fe65-4ba7-8044-a0b38ac85c54 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:49.424559 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9b2cccea-fe65-4ba7-8044-a0b38ac85c54 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:49.425039 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9b2cccea-fe65-4ba7-8044-a0b38ac85c54 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:49.425474 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9b2cccea-fe65-4ba7-8044-a0b38ac85c54 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:49.426170 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9b2cccea-fe65-4ba7-8044-a0b38ac85c54 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:49.426622 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9b2cccea-fe65-4ba7-8044-a0b38ac85c54 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:49.427063 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9b2cccea-fe65-4ba7-8044-a0b38ac85c54 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:49.557184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9b2cccea-fe65-4ba7-8044-a0b38ac85c54 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:49.564757 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9b2cccea-fe65-4ba7-8044-a0b38ac85c54 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1260 microversion: 2.1 time: 0.151260 Aug 08 14:34:49.565326 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 283/592] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:49 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:50.585383 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6f953997-7f4c-4ff4-8e90-71bb736bfa2b tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:50.586014 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6f953997-7f4c-4ff4-8e90-71bb736bfa2b tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:50.592483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f953997-7f4c-4ff4-8e90-71bb736bfa2b tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:50.592993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f953997-7f4c-4ff4-8e90-71bb736bfa2b tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:50.593424 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f953997-7f4c-4ff4-8e90-71bb736bfa2b tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:50.594116 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f953997-7f4c-4ff4-8e90-71bb736bfa2b tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:50.594564 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f953997-7f4c-4ff4-8e90-71bb736bfa2b tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:50.594977 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f953997-7f4c-4ff4-8e90-71bb736bfa2b tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:50.740543 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6f953997-7f4c-4ff4-8e90-71bb736bfa2b tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:50.748366 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6f953997-7f4c-4ff4-8e90-71bb736bfa2b tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1445 microversion: 2.1 time: 0.166781 Aug 08 14:34:50.749443 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 310/593] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:50 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1445 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:50.768842 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4dc006ec-666a-447b-8b49-0b1582bdaf13 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:50.769484 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4dc006ec-666a-447b-8b49-0b1582bdaf13 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:50.776698 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4dc006ec-666a-447b-8b49-0b1582bdaf13 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:50.777190 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4dc006ec-666a-447b-8b49-0b1582bdaf13 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:50.777629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4dc006ec-666a-447b-8b49-0b1582bdaf13 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:50.778344 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4dc006ec-666a-447b-8b49-0b1582bdaf13 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:50.778799 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4dc006ec-666a-447b-8b49-0b1582bdaf13 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:50.779265 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4dc006ec-666a-447b-8b49-0b1582bdaf13 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:50.784676 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1064798733", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "networks": [{"uuid": "a2b2adbc-941f-4fb5-aefc-3ec0cd5b62e0"}]}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:50.846400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.network.neutron [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] validate_networks() for [('a2b2adbc-941f-4fb5-aefc-3ec0cd5b62e0', None, None, None, None, None)] {{(pid=118062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:34:50.990766 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4dc006ec-666a-447b-8b49-0b1582bdaf13 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:50.998319 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4dc006ec-666a-447b-8b49-0b1582bdaf13 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1445 microversion: 2.1 time: 0.233408 Aug 08 14:34:50.999072 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 284/594] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:50 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1445 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:51.318768 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Flavor limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:34:51.319201 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Image limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:34:51.320138 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Flavor pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:34:51.320556 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Image pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:34:51.321156 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:34:51.331573 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:51.332046 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:51.332699 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:51.334182 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:51.334878 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:51.335550 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:51.353377 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Getting quotas for project 693b1fece5b548c786a495d2dc91bd8a. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:34:51.357624 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Getting quotas for user 57e1243ffa724189ba7d2b9277e10afd and project 693b1fece5b548c786a495d2dc91bd8a. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:34:51.370126 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Going to run 1 instances... {{(pid=118062) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:34:51.372410 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:34:51.420349 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1a295090-0cea-48a0-82ef-f591abc2bee6 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639483 Aug 08 14:34:51.421198 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 311/595] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:34:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 14:34:51.432389 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9245c893-075b-4d10-9189-421b2bcf623a tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:51.432912 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9245c893-075b-4d10-9189-421b2bcf623a tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:51.496825 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9245c893-075b-4d10-9189-421b2bcf623a tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:51.504116 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9245c893-075b-4d10-9189-421b2bcf623a tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1219 microversion: 2.1 time: 0.075552 Aug 08 14:34:51.504697 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 285/596] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:51 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:52.526575 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-62529efa-14ce-469f-aac0-c40287e76898 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:52.527296 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-62529efa-14ce-469f-aac0-c40287e76898 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:52.533657 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-62529efa-14ce-469f-aac0-c40287e76898 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:52.534016 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-62529efa-14ce-469f-aac0-c40287e76898 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:52.534606 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-62529efa-14ce-469f-aac0-c40287e76898 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:52.537132 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-62529efa-14ce-469f-aac0-c40287e76898 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:52.537132 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-62529efa-14ce-469f-aac0-c40287e76898 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:52.537132 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-62529efa-14ce-469f-aac0-c40287e76898 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:52.618043 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-62529efa-14ce-469f-aac0-c40287e76898 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:52.629382 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-62529efa-14ce-469f-aac0-c40287e76898 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1271 microversion: 2.1 time: 0.107334 Aug 08 14:34:52.631628 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 312/597] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:52 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:53.651805 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-aba30ebc-1883-469f-9307-1b91475f0c06 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:53.653045 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-aba30ebc-1883-469f-9307-1b91475f0c06 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:53.659649 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aba30ebc-1883-469f-9307-1b91475f0c06 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:53.660138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aba30ebc-1883-469f-9307-1b91475f0c06 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:53.660576 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aba30ebc-1883-469f-9307-1b91475f0c06 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:53.661318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aba30ebc-1883-469f-9307-1b91475f0c06 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:53.661768 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aba30ebc-1883-469f-9307-1b91475f0c06 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:53.662189 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aba30ebc-1883-469f-9307-1b91475f0c06 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:53.693667 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-7a6c8cb3-9981-4ccb-ad75-b1cf5f160bc7 req-d5cde89c-6af2-48c7-95ca-1c447539e1bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eff17af-e081-4582-82fb-ba2f7a45c338", "tag": "54289b72-3379-4dba-9ae7-835b040e581b"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:53.727379 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-7a6c8cb3-9981-4ccb-ad75-b1cf5f160bc7 req-d5cde89c-6af2-48c7-95ca-1c447539e1bf service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:53.727750 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-7a6c8cb3-9981-4ccb-ad75-b1cf5f160bc7 req-d5cde89c-6af2-48c7-95ca-1c447539e1bf service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:53.728185 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-7a6c8cb3-9981-4ccb-ad75-b1cf5f160bc7 req-d5cde89c-6af2-48c7-95ca-1c447539e1bf service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:53.740929 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-7a6c8cb3-9981-4ccb-ad75-b1cf5f160bc7 req-d5cde89c-6af2-48c7-95ca-1c447539e1bf service nova] Creating event network-changed:54289b72-3379-4dba-9ae7-835b040e581b for instance 0eff17af-e081-4582-82fb-ba2f7a45c338 on hv-cinder-85200 Aug 08 14:34:53.747558 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-7a6c8cb3-9981-4ccb-ad75-b1cf5f160bc7 req-d5cde89c-6af2-48c7-95ca-1c447539e1bf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058746 Aug 08 14:34:53.748903 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 313/598] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:34:53.828699 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-aba30ebc-1883-469f-9307-1b91475f0c06 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:53.836092 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-aba30ebc-1883-469f-9307-1b91475f0c06 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1319 microversion: 2.1 time: 0.188087 Aug 08 14:34:53.837781 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 286/599] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:53 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:54.871427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b941f902-11ad-4491-8ad2-1b18b77339ab tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:54.873062 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b941f902-11ad-4491-8ad2-1b18b77339ab tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:54.898241 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b941f902-11ad-4491-8ad2-1b18b77339ab tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:54.899971 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b941f902-11ad-4491-8ad2-1b18b77339ab tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:54.904091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b941f902-11ad-4491-8ad2-1b18b77339ab tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:54.904558 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b941f902-11ad-4491-8ad2-1b18b77339ab tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:54.905331 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b941f902-11ad-4491-8ad2-1b18b77339ab tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:54.906258 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b941f902-11ad-4491-8ad2-1b18b77339ab tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:55.075235 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b941f902-11ad-4491-8ad2-1b18b77339ab tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:55.085090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b941f902-11ad-4491-8ad2-1b18b77339ab tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1319 microversion: 2.1 time: 0.230879 Aug 08 14:34:55.086275 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 314/600] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:54 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:55.769231 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-0eee0fad-b134-45b9-bb3d-0128e4c979e4 req-c0cd57c9-b364-4d77-85f3-ce927b023703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61b75b2c-76ff-4530-9553-9fb04db7c082", "tag": "d9f0a1fb-b83d-4e01-9a8d-1388224f3e9c"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:34:55.782330 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0eee0fad-b134-45b9-bb3d-0128e4c979e4 req-c0cd57c9-b364-4d77-85f3-ce927b023703 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:55.782810 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0eee0fad-b134-45b9-bb3d-0128e4c979e4 req-c0cd57c9-b364-4d77-85f3-ce927b023703 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:55.783279 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0eee0fad-b134-45b9-bb3d-0128e4c979e4 req-c0cd57c9-b364-4d77-85f3-ce927b023703 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:55.794486 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-0eee0fad-b134-45b9-bb3d-0128e4c979e4 req-c0cd57c9-b364-4d77-85f3-ce927b023703 service nova] Creating event network-changed:d9f0a1fb-b83d-4e01-9a8d-1388224f3e9c for instance 61b75b2c-76ff-4530-9553-9fb04db7c082 on hv-cinder-85200 Aug 08 14:34:55.799552 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-0eee0fad-b134-45b9-bb3d-0128e4c979e4 req-c0cd57c9-b364-4d77-85f3-ce927b023703 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034174 Aug 08 14:34:55.800143 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 287/601] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:34:56.106311 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-aa0ca986-7bb3-41ff-ae49-280c60b08880 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:56.106921 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-aa0ca986-7bb3-41ff-ae49-280c60b08880 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:56.113371 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aa0ca986-7bb3-41ff-ae49-280c60b08880 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:56.113848 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aa0ca986-7bb3-41ff-ae49-280c60b08880 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:56.114285 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aa0ca986-7bb3-41ff-ae49-280c60b08880 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:56.115508 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aa0ca986-7bb3-41ff-ae49-280c60b08880 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:56.115960 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aa0ca986-7bb3-41ff-ae49-280c60b08880 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:56.116379 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aa0ca986-7bb3-41ff-ae49-280c60b08880 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:56.244982 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-aa0ca986-7bb3-41ff-ae49-280c60b08880 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:56.252486 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-aa0ca986-7bb3-41ff-ae49-280c60b08880 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1319 microversion: 2.1 time: 0.150101 Aug 08 14:34:56.253063 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 315/602] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:56 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:57.274686 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ad42ee48-2691-4d5c-a909-c2b8355c3f00 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:57.275671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ad42ee48-2691-4d5c-a909-c2b8355c3f00 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:57.281999 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad42ee48-2691-4d5c-a909-c2b8355c3f00 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:57.282486 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad42ee48-2691-4d5c-a909-c2b8355c3f00 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:57.282923 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad42ee48-2691-4d5c-a909-c2b8355c3f00 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:57.283663 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad42ee48-2691-4d5c-a909-c2b8355c3f00 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:57.284121 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad42ee48-2691-4d5c-a909-c2b8355c3f00 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:57.284552 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad42ee48-2691-4d5c-a909-c2b8355c3f00 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:57.468790 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ad42ee48-2691-4d5c-a909-c2b8355c3f00 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:57.477664 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ad42ee48-2691-4d5c-a909-c2b8355c3f00 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1319 microversion: 2.1 time: 0.208188 Aug 08 14:34:57.478362 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 288/603] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:57 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:58.498895 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-95138d57-c94f-4742-97b2-d8547679e0b4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:58.499509 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-95138d57-c94f-4742-97b2-d8547679e0b4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:58.506419 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-95138d57-c94f-4742-97b2-d8547679e0b4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:58.506892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-95138d57-c94f-4742-97b2-d8547679e0b4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:58.507359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-95138d57-c94f-4742-97b2-d8547679e0b4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:58.508037 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-95138d57-c94f-4742-97b2-d8547679e0b4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:58.508482 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-95138d57-c94f-4742-97b2-d8547679e0b4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:58.508898 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-95138d57-c94f-4742-97b2-d8547679e0b4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:58.638042 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-95138d57-c94f-4742-97b2-d8547679e0b4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:58.645623 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-95138d57-c94f-4742-97b2-d8547679e0b4 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1319 microversion: 2.1 time: 0.150561 Aug 08 14:34:58.646880 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 316/604] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:58 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:34:59.670391 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0be1cc9b-1614-4fc8-94ff-385e8ef285e9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:34:59.671959 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0be1cc9b-1614-4fc8-94ff-385e8ef285e9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:34:59.683331 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0be1cc9b-1614-4fc8-94ff-385e8ef285e9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:59.684137 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0be1cc9b-1614-4fc8-94ff-385e8ef285e9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:59.684609 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0be1cc9b-1614-4fc8-94ff-385e8ef285e9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:59.685813 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0be1cc9b-1614-4fc8-94ff-385e8ef285e9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:34:59.687018 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0be1cc9b-1614-4fc8-94ff-385e8ef285e9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:34:59.687788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0be1cc9b-1614-4fc8-94ff-385e8ef285e9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:34:59.840126 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0be1cc9b-1614-4fc8-94ff-385e8ef285e9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:34:59.847615 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0be1cc9b-1614-4fc8-94ff-385e8ef285e9 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1319 microversion: 2.1 time: 0.184721 Aug 08 14:34:59.848209 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 289/605] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:34:59 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:00.871440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-73a9fb41-2e7d-4f20-8eb0-e0a77f735d1d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:00.872093 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-73a9fb41-2e7d-4f20-8eb0-e0a77f735d1d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:00.886890 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-73a9fb41-2e7d-4f20-8eb0-e0a77f735d1d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:00.887424 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-73a9fb41-2e7d-4f20-8eb0-e0a77f735d1d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:00.887901 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-73a9fb41-2e7d-4f20-8eb0-e0a77f735d1d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:00.888607 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-73a9fb41-2e7d-4f20-8eb0-e0a77f735d1d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:00.889129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-73a9fb41-2e7d-4f20-8eb0-e0a77f735d1d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:00.889551 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-73a9fb41-2e7d-4f20-8eb0-e0a77f735d1d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:01.035193 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-73a9fb41-2e7d-4f20-8eb0-e0a77f735d1d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:01.048203 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-73a9fb41-2e7d-4f20-8eb0-e0a77f735d1d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1319 microversion: 2.1 time: 0.178370 Aug 08 14:35:01.049528 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 317/606] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:00 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:01.233683 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-2b93257a-b96b-4513-a84d-84f93f07a190 req-8283bd35-f8c5-47f5-b6d1-3255ac9d5609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b75b2c-76ff-4530-9553-9fb04db7c082", "name": "network-vif-plugged", "status": "completed", "tag": "d9f0a1fb-b83d-4e01-9a8d-1388224f3e9c"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:01.245494 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2b93257a-b96b-4513-a84d-84f93f07a190 req-8283bd35-f8c5-47f5-b6d1-3255ac9d5609 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:01.246308 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2b93257a-b96b-4513-a84d-84f93f07a190 req-8283bd35-f8c5-47f5-b6d1-3255ac9d5609 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:01.247752 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2b93257a-b96b-4513-a84d-84f93f07a190 req-8283bd35-f8c5-47f5-b6d1-3255ac9d5609 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:01.260272 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-2b93257a-b96b-4513-a84d-84f93f07a190 req-8283bd35-f8c5-47f5-b6d1-3255ac9d5609 service nova] Creating event network-vif-plugged:d9f0a1fb-b83d-4e01-9a8d-1388224f3e9c for instance 61b75b2c-76ff-4530-9553-9fb04db7c082 on hv-cinder-85200 Aug 08 14:35:01.268369 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-2b93257a-b96b-4513-a84d-84f93f07a190 req-8283bd35-f8c5-47f5-b6d1-3255ac9d5609 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039258 Aug 08 14:35:01.269199 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 290/607] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:02.070568 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f88432d6-2450-4a4e-b62b-545120506f91 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:02.071211 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f88432d6-2450-4a4e-b62b-545120506f91 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:02.073280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:02.073931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=6 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:02.080566 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f88432d6-2450-4a4e-b62b-545120506f91 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:02.081049 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f88432d6-2450-4a4e-b62b-545120506f91 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:02.081513 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f88432d6-2450-4a4e-b62b-545120506f91 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:02.082217 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f88432d6-2450-4a4e-b62b-545120506f91 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:02.082672 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f88432d6-2450-4a4e-b62b-545120506f91 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:02.083120 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f88432d6-2450-4a4e-b62b-545120506f91 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:02.218705 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f88432d6-2450-4a4e-b62b-545120506f91 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:02.226804 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f88432d6-2450-4a4e-b62b-545120506f91 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1319 microversion: 2.1 time: 0.160823 Aug 08 14:35:02.227617 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 318/608] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:02 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:03.245704 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:03.252392 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-269d6f0c-028f-4f2f-acf6-5a55483b306d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:03.253369 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-269d6f0c-028f-4f2f-acf6-5a55483b306d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:03.261365 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-269d6f0c-028f-4f2f-acf6-5a55483b306d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:03.261813 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-269d6f0c-028f-4f2f-acf6-5a55483b306d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:03.262676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-269d6f0c-028f-4f2f-acf6-5a55483b306d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:03.263680 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-269d6f0c-028f-4f2f-acf6-5a55483b306d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:03.263803 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-269d6f0c-028f-4f2f-acf6-5a55483b306d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:03.264361 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-269d6f0c-028f-4f2f-acf6-5a55483b306d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:03.515520 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-269d6f0c-028f-4f2f-acf6-5a55483b306d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:03.526869 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-269d6f0c-028f-4f2f-acf6-5a55483b306d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1319 microversion: 2.1 time: 0.281891 Aug 08 14:35:03.528332 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 291/609] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:03 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:04.548638 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f0ea0846-52a2-40aa-82e9-b9fcb6ab22a3 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:04.549245 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f0ea0846-52a2-40aa-82e9-b9fcb6ab22a3 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:04.562049 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f0ea0846-52a2-40aa-82e9-b9fcb6ab22a3 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:04.562577 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f0ea0846-52a2-40aa-82e9-b9fcb6ab22a3 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:04.563012 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f0ea0846-52a2-40aa-82e9-b9fcb6ab22a3 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:04.574697 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f0ea0846-52a2-40aa-82e9-b9fcb6ab22a3 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:04.575196 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f0ea0846-52a2-40aa-82e9-b9fcb6ab22a3 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:04.575826 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f0ea0846-52a2-40aa-82e9-b9fcb6ab22a3 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:04.761606 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f0ea0846-52a2-40aa-82e9-b9fcb6ab22a3 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:04.770425 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f0ea0846-52a2-40aa-82e9-b9fcb6ab22a3 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1319 microversion: 2.1 time: 0.225610 Aug 08 14:35:04.785692 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 319/610] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:04 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:05.794481 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c7a0f5d2-8f16-41c0-85db-24ee28e28e03 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:05.795187 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c7a0f5d2-8f16-41c0-85db-24ee28e28e03 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:05.802709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7a0f5d2-8f16-41c0-85db-24ee28e28e03 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:05.803231 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7a0f5d2-8f16-41c0-85db-24ee28e28e03 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:05.803671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7a0f5d2-8f16-41c0-85db-24ee28e28e03 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:05.804382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7a0f5d2-8f16-41c0-85db-24ee28e28e03 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:05.804836 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7a0f5d2-8f16-41c0-85db-24ee28e28e03 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:05.805262 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7a0f5d2-8f16-41c0-85db-24ee28e28e03 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:05.809671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=99 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:06.104011 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c7a0f5d2-8f16-41c0-85db-24ee28e28e03 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:06.115258 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c7a0f5d2-8f16-41c0-85db-24ee28e28e03 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1509 microversion: 2.1 time: 0.325898 Aug 08 14:35:06.116208 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 292/611] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:05 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1509 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:06.140983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8a8b5d01-c5c7-455a-9919-105c240c9f3d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b9b2fcb-3343-4d68-afea-276ea2586007", "device": "/dev/sdb"}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:06.144474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8a8b5d01-c5c7-455a-9919-105c240c9f3d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:06.152192 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a8b5d01-c5c7-455a-9919-105c240c9f3d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:06.152683 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a8b5d01-c5c7-455a-9919-105c240c9f3d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:06.153282 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a8b5d01-c5c7-455a-9919-105c240c9f3d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:06.153983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a8b5d01-c5c7-455a-9919-105c240c9f3d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:06.154605 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a8b5d01-c5c7-455a-9919-105c240c9f3d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:06.155026 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a8b5d01-c5c7-455a-9919-105c240c9f3d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:06.465690 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:06.492564 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8a8b5d01-c5c7-455a-9919-105c240c9f3d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "POST /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358072 Aug 08 14:35:06.499157 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 320/612] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 14:35:06 2022] POST /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:06.545624 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-501a7b61-16bd-4752-9328-19c4f84b103f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:06.546442 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-501a7b61-16bd-4752-9328-19c4f84b103f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:06.559389 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-501a7b61-16bd-4752-9328-19c4f84b103f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:06.560816 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-501a7b61-16bd-4752-9328-19c4f84b103f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:06.562113 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-501a7b61-16bd-4752-9328-19c4f84b103f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:06.565276 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-501a7b61-16bd-4752-9328-19c4f84b103f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:06.565894 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-501a7b61-16bd-4752-9328-19c4f84b103f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:06.566979 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-501a7b61-16bd-4752-9328-19c4f84b103f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:06.736855 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-501a7b61-16bd-4752-9328-19c4f84b103f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lazy-loading 'services' on Instance uuid b4c76439-3c30-47b1-a13c-cee630ea057b {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:35:06.885644 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-501a7b61-16bd-4752-9328-19c4f84b103f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/os-volume_attachments/8ce0c35d-c1df-417e-9b83-a8e38e7f4b4d" status: 202 len: 0 microversion: 2.1 time: 0.345227 Aug 08 14:35:06.887039 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 293/613] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 14:35:06 2022] DELETE /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/os-volume_attachments/8ce0c35d-c1df-417e-9b83-a8e38e7f4b4d => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:35:15.552287 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-452f1622-003f-471c-9d89-91f387725e03 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:15.554778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:15.575684 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-452f1622-003f-471c-9d89-91f387725e03 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:15.576191 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-452f1622-003f-471c-9d89-91f387725e03 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:15.576671 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-452f1622-003f-471c-9d89-91f387725e03 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:15.604597 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-452f1622-003f-471c-9d89-91f387725e03 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Going to try to stop instance {{(pid=118062) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 14:35:15.656784 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-452f1622-003f-471c-9d89-91f387725e03 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "POST /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/action" status: 202 len: 0 microversion: 2.1 time: 0.112644 Aug 08 14:35:15.657547 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 321/614] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 14:35:15 2022] POST /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:35:15.675262 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6ef954f1-567c-4db7-9957-b17846e23643 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:15.677510 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6ef954f1-567c-4db7-9957-b17846e23643 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:15.689058 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=30 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:15.692084 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6ef954f1-567c-4db7-9957-b17846e23643 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:15.692628 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6ef954f1-567c-4db7-9957-b17846e23643 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:15.693291 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6ef954f1-567c-4db7-9957-b17846e23643 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:15.694010 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6ef954f1-567c-4db7-9957-b17846e23643 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:15.694465 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6ef954f1-567c-4db7-9957-b17846e23643 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:15.694886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6ef954f1-567c-4db7-9957-b17846e23643 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:15.848113 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6ef954f1-567c-4db7-9957-b17846e23643 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:15.857636 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6ef954f1-567c-4db7-9957-b17846e23643 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.186421 Aug 08 14:35:15.858219 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 294/615] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:15 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:16.132510 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6f0d935e-4053-4929-95bd-a703d0419ef7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:16.133492 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6f0d935e-4053-4929-95bd-a703d0419ef7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:16.140091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f0d935e-4053-4929-95bd-a703d0419ef7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:16.140856 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f0d935e-4053-4929-95bd-a703d0419ef7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:16.141354 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f0d935e-4053-4929-95bd-a703d0419ef7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:16.142255 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f0d935e-4053-4929-95bd-a703d0419ef7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:16.142783 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f0d935e-4053-4929-95bd-a703d0419ef7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:16.143337 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6f0d935e-4053-4929-95bd-a703d0419ef7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:16.173204 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6f0d935e-4053-4929-95bd-a703d0419ef7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325/ips" status: 200 len: 148 microversion: 2.1 time: 0.045619 Aug 08 14:35:16.174155 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 322/616] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 14:35:16 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325/ips => generated 148 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:16.186995 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4f03583c-4b9a-4a5d-872d-82618ab4b17c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb2e329d-3492-4c8d-96df-3172a85c5169"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:16.189645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4f03583c-4b9a-4a5d-872d-82618ab4b17c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:16.196444 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4f03583c-4b9a-4a5d-872d-82618ab4b17c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:16.197172 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4f03583c-4b9a-4a5d-872d-82618ab4b17c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:16.197635 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4f03583c-4b9a-4a5d-872d-82618ab4b17c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:16.198388 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4f03583c-4b9a-4a5d-872d-82618ab4b17c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:16.198841 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4f03583c-4b9a-4a5d-872d-82618ab4b17c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:16.199293 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4f03583c-4b9a-4a5d-872d-82618ab4b17c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:16.296004 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-4f03583c-4b9a-4a5d-872d-82618ab4b17c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] HTTP exception thrown: Invalid volume: volume cb2e329d-3492-4c8d-96df-3172a85c5169 is already attached to instances: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4f03583c-4b9a-4a5d-872d-82618ab4b17c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Request method failure captured: Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: POST /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325/os-volume_attachments HTTP/1.1 Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 74 Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4nDHzBnzio2VZ6ciHSRMNEEHFIYRjyMTvKRDfIH2F_niI0FcU0ZqBeBBZkKpUdHOb90TorX284g0qMdisJyL77Y3j06R-x49-mqWZufa0BFWwlg29tIQoalg1p609ZLEly-KDP4mLoxCO4eWlqZVpPuU5-IPf0H50niq4AklVZ208 Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:35:16.298019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:35:16.299709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc86120e53145328dd430f542e73182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc86120e53145328dd430f542e73182", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}] Aug 08 14:35:16.299709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:35:16.299709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:35:16.299709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:35:16.299709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:35:16.299709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:35:16.299709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:35:16.299709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 48a91f6797cc4604ba2606e0549234d0 Aug 08 14:35:16.299709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:35:16.299709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Aug 08 14:35:16.299709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {"volumeAttachment": {"volumeId": "cb2e329d-3492-4c8d-96df-3172a85c5169"}} Aug 08 14:35:16.299709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Invalid volume: volume cb2e329d-3492-4c8d-96df-3172a85c5169 is already attached to instances: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'server_id': 'c19ca8ed-1d03-4d63-9e99-900018554325', 'body': {'volumeAttachment': {'volumeId': 'cb2e329d-3492-4c8d-96df-3172a85c5169'}}} Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cb2e329d-3492-4c8d-96df-3172a85c5169 is already attached to instances: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:35:16.300460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cb2e329d-3492-4c8d-96df-3172a85c5169 is already attached to instances: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:16.302161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:35:16.303413 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:35:16.303413 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:35:16.303413 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:35:16.303413 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cb2e329d-3492-4c8d-96df-3172a85c5169 is already attached to instances: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 Aug 08 14:35:16.303413 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:35:16.303413 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4f03583c-4b9a-4a5d-872d-82618ab4b17c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Returning 400 to user: Invalid volume: volume cb2e329d-3492-4c8d-96df-3172a85c5169 is already attached to instances: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:35:16.303413 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4f03583c-4b9a-4a5d-872d-82618ab4b17c tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "POST /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116620 Aug 08 14:35:16.304711 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 295/617] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 14:35:16 2022] POST /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325/os-volume_attachments => generated 174 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 14:35:16.310531 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e1aed163-e404-4763-bc66-ad958373c7d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:16.311158 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e1aed163-e404-4763-bc66-ad958373c7d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:16.318729 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e1aed163-e404-4763-bc66-ad958373c7d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:16.319330 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e1aed163-e404-4763-bc66-ad958373c7d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:16.319853 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e1aed163-e404-4763-bc66-ad958373c7d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:16.320566 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e1aed163-e404-4763-bc66-ad958373c7d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:16.321025 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e1aed163-e404-4763-bc66-ad958373c7d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:16.321510 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e1aed163-e404-4763-bc66-ad958373c7d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:16.350350 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e1aed163-e404-4763-bc66-ad958373c7d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Going to try to terminate instance {{(pid=118062) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:35:16.432812 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e1aed163-e404-4763-bc66-ad958373c7d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 204 len: 0 microversion: 2.1 time: 0.125877 Aug 08 14:35:16.435180 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 323/618] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:35:16 2022] DELETE /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:35:16.443429 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a0131f89-91e4-4c17-8702-94f768e32ff2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:16.444092 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a0131f89-91e4-4c17-8702-94f768e32ff2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:16.451626 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0131f89-91e4-4c17-8702-94f768e32ff2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:16.452121 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0131f89-91e4-4c17-8702-94f768e32ff2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:16.452712 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0131f89-91e4-4c17-8702-94f768e32ff2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:16.453424 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0131f89-91e4-4c17-8702-94f768e32ff2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:16.453981 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0131f89-91e4-4c17-8702-94f768e32ff2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:16.454417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0131f89-91e4-4c17-8702-94f768e32ff2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:16.648043 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a0131f89-91e4-4c17-8702-94f768e32ff2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:16.661850 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a0131f89-91e4-4c17-8702-94f768e32ff2 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1680 microversion: 2.1 time: 0.222899 Aug 08 14:35:16.662676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 296/619] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:16 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1680 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:16.879773 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-094e4203-ac3a-475a-95ca-373533963b7c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:16.882912 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-094e4203-ac3a-475a-95ca-373533963b7c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:16.889187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-094e4203-ac3a-475a-95ca-373533963b7c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:16.889679 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-094e4203-ac3a-475a-95ca-373533963b7c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:16.890121 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-094e4203-ac3a-475a-95ca-373533963b7c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:16.890828 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-094e4203-ac3a-475a-95ca-373533963b7c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:16.891320 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-094e4203-ac3a-475a-95ca-373533963b7c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:16.891751 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-094e4203-ac3a-475a-95ca-373533963b7c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:17.044414 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-094e4203-ac3a-475a-95ca-373533963b7c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:17.052693 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-094e4203-ac3a-475a-95ca-373533963b7c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.177143 Aug 08 14:35:17.053595 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 324/620] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:16 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:17.684098 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ba000d3d-68dd-496c-9a5d-234094bb5065 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:17.685747 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ba000d3d-68dd-496c-9a5d-234094bb5065 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:17.690863 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba000d3d-68dd-496c-9a5d-234094bb5065 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:17.691421 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba000d3d-68dd-496c-9a5d-234094bb5065 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:17.691855 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba000d3d-68dd-496c-9a5d-234094bb5065 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:17.693319 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba000d3d-68dd-496c-9a5d-234094bb5065 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:17.693766 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba000d3d-68dd-496c-9a5d-234094bb5065 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:17.694186 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba000d3d-68dd-496c-9a5d-234094bb5065 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:17.849635 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ba000d3d-68dd-496c-9a5d-234094bb5065 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:17.864700 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ba000d3d-68dd-496c-9a5d-234094bb5065 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1680 microversion: 2.1 time: 0.184372 Aug 08 14:35:17.865818 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 297/621] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:17 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:18.073946 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f8ba52cb-4ea6-45d1-aafc-bc2c3e5d2d3e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:18.075279 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f8ba52cb-4ea6-45d1-aafc-bc2c3e5d2d3e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:18.082615 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f8ba52cb-4ea6-45d1-aafc-bc2c3e5d2d3e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:18.083639 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f8ba52cb-4ea6-45d1-aafc-bc2c3e5d2d3e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:18.084330 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f8ba52cb-4ea6-45d1-aafc-bc2c3e5d2d3e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:18.085038 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f8ba52cb-4ea6-45d1-aafc-bc2c3e5d2d3e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:18.085494 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f8ba52cb-4ea6-45d1-aafc-bc2c3e5d2d3e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:18.085924 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f8ba52cb-4ea6-45d1-aafc-bc2c3e5d2d3e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:18.233630 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f8ba52cb-4ea6-45d1-aafc-bc2c3e5d2d3e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:18.242491 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f8ba52cb-4ea6-45d1-aafc-bc2c3e5d2d3e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.172453 Aug 08 14:35:18.243047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 325/622] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:18 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:18.886844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-68461d92-df7d-4c22-8211-9f85cf04d5c0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:18.887597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-68461d92-df7d-4c22-8211-9f85cf04d5c0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:18.894714 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-68461d92-df7d-4c22-8211-9f85cf04d5c0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:18.895947 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-68461d92-df7d-4c22-8211-9f85cf04d5c0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:18.896477 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-68461d92-df7d-4c22-8211-9f85cf04d5c0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:18.897282 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-68461d92-df7d-4c22-8211-9f85cf04d5c0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:18.897723 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-68461d92-df7d-4c22-8211-9f85cf04d5c0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:18.898228 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-68461d92-df7d-4c22-8211-9f85cf04d5c0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:18.982331 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-eb072885-aea7-4df8-b949-512ba3f0ce65 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Action: 'create', calling method: .version_select at 0x7f9cb25503a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2050739285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPziM7WFOYhj660txZAe/3Y9NTVeFZJxN9thoLu9wv0FnNKj3ZEVecmTO7tuB9r++DkiAg5Y1hwm4Fl1tyQY/9cEJ1e5WgV7KVUspgyDX9dPSEbANftlSSf1K/W9F0Evlw=="}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:18.998139 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-eb072885-aea7-4df8-b949-512ba3f0ce65 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Getting quotas for project 90d6ef85228f4676b9ac19e123e1462a. Resources: {'key_pairs'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:35:19.002211 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-eb072885-aea7-4df8-b949-512ba3f0ce65 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Getting quotas for user 3cc610fe5d814027b01236949e145430 and project 90d6ef85228f4676b9ac19e123e1462a. Resources: {'key_pairs'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:35:19.025989 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-eb072885-aea7-4df8-b949-512ba3f0ce65 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047373 Aug 08 14:35:19.026591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 326/623] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 14:35:18 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:35:19.038507 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-68461d92-df7d-4c22-8211-9f85cf04d5c0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:19.046354 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-68461d92-df7d-4c22-8211-9f85cf04d5c0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1680 microversion: 2.1 time: 0.163797 Aug 08 14:35:19.046921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 298/624] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:18 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:19.077835 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1759441283", "imageRef": "e7a17a3d-a89a-413c-b74d-7717259f9703", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2050739285", "networks": [{"uuid": "ff882bed-8496-4dba-8a11-de9c64d6f608"}]}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:19.130637 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.network.neutron [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] validate_networks() for [('ff882bed-8496-4dba-8a11-de9c64d6f608', None, None, None, None, None)] {{(pid=118062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:35:19.264819 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-15738732-0c89-4843-8bd2-55f16f4e7249 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:19.265423 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-15738732-0c89-4843-8bd2-55f16f4e7249 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:19.271741 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15738732-0c89-4843-8bd2-55f16f4e7249 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:19.272372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15738732-0c89-4843-8bd2-55f16f4e7249 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:19.272841 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15738732-0c89-4843-8bd2-55f16f4e7249 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:19.273552 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15738732-0c89-4843-8bd2-55f16f4e7249 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:19.274109 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15738732-0c89-4843-8bd2-55f16f4e7249 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:19.274446 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15738732-0c89-4843-8bd2-55f16f4e7249 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:19.484596 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-15738732-0c89-4843-8bd2-55f16f4e7249 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:19.492953 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-15738732-0c89-4843-8bd2-55f16f4e7249 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.231969 Aug 08 14:35:19.493457 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 299/625] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:19 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:19.811798 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Flavor limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:35:19.812224 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Image limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:35:19.812702 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Flavor pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:35:19.813138 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Image pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:35:19.813549 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:35:19.822119 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:19.822601 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:19.823034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:19.823787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:19.824240 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:19.824664 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:19.840610 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Getting quotas for project 90d6ef85228f4676b9ac19e123e1462a. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:35:19.844436 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Getting quotas for user 3cc610fe5d814027b01236949e145430 and project 90d6ef85228f4676b9ac19e123e1462a. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:35:19.855536 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Going to run 1 instances... {{(pid=118062) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:35:19.857748 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7a17a3d-a89a-413c-b74d-7717259f9703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:35:19.904582 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9ce5f717-ff2e-4a16-93c2-18548a90c1b8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830643 Aug 08 14:35:19.905435 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 327/626] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:35:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:35:19.916802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8886240b-a07c-433a-aadd-cd74a5c44719 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:19.917995 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8886240b-a07c-433a-aadd-cd74a5c44719 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:19.972327 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8886240b-a07c-433a-aadd-cd74a5c44719 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:19.980552 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8886240b-a07c-433a-aadd-cd74a5c44719 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1259 microversion: 2.1 time: 0.067887 Aug 08 14:35:19.981136 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 300/627] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:19 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:20.067617 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7866988f-5402-4049-813c-e2319c80e3c9 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:20.068318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7866988f-5402-4049-813c-e2319c80e3c9 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:20.075071 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7866988f-5402-4049-813c-e2319c80e3c9 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:20.075672 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7866988f-5402-4049-813c-e2319c80e3c9 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:20.076190 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7866988f-5402-4049-813c-e2319c80e3c9 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:20.076957 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7866988f-5402-4049-813c-e2319c80e3c9 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:20.077554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7866988f-5402-4049-813c-e2319c80e3c9 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:20.078302 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7866988f-5402-4049-813c-e2319c80e3c9 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:20.218145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7866988f-5402-4049-813c-e2319c80e3c9 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:20.226895 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7866988f-5402-4049-813c-e2319c80e3c9 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1680 microversion: 2.1 time: 0.163204 Aug 08 14:35:20.227504 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 328/628] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:20 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:20.514045 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-405e8227-edf3-4ac1-b0a4-8d43cb07326e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:20.514650 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-405e8227-edf3-4ac1-b0a4-8d43cb07326e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:20.521762 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-405e8227-edf3-4ac1-b0a4-8d43cb07326e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:20.522241 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-405e8227-edf3-4ac1-b0a4-8d43cb07326e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:20.522671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-405e8227-edf3-4ac1-b0a4-8d43cb07326e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:20.523387 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-405e8227-edf3-4ac1-b0a4-8d43cb07326e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:20.523841 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-405e8227-edf3-4ac1-b0a4-8d43cb07326e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:20.524265 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-405e8227-edf3-4ac1-b0a4-8d43cb07326e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:20.655111 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-405e8227-edf3-4ac1-b0a4-8d43cb07326e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:20.662620 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-405e8227-edf3-4ac1-b0a4-8d43cb07326e tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.152426 Aug 08 14:35:20.663213 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 301/629] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:20 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:21.000865 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ac7e5b16-bbe2-4b7f-b27d-48ffabe549ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:21.001528 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ac7e5b16-bbe2-4b7f-b27d-48ffabe549ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:21.007424 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ac7e5b16-bbe2-4b7f-b27d-48ffabe549ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:21.007902 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ac7e5b16-bbe2-4b7f-b27d-48ffabe549ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:21.008334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ac7e5b16-bbe2-4b7f-b27d-48ffabe549ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:21.009017 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ac7e5b16-bbe2-4b7f-b27d-48ffabe549ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:21.009462 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ac7e5b16-bbe2-4b7f-b27d-48ffabe549ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:21.009886 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ac7e5b16-bbe2-4b7f-b27d-48ffabe549ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:21.070068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ac7e5b16-bbe2-4b7f-b27d-48ffabe549ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:21.077322 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ac7e5b16-bbe2-4b7f-b27d-48ffabe549ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1263 microversion: 2.1 time: 0.080466 Aug 08 14:35:21.077883 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 329/630] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:20 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:21.247999 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1dd8e0f0-abaf-4a1a-a7a4-285e8e451967 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:21.248608 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1dd8e0f0-abaf-4a1a-a7a4-285e8e451967 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:21.254893 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1dd8e0f0-abaf-4a1a-a7a4-285e8e451967 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:21.255399 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1dd8e0f0-abaf-4a1a-a7a4-285e8e451967 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:21.255843 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1dd8e0f0-abaf-4a1a-a7a4-285e8e451967 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:21.256526 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1dd8e0f0-abaf-4a1a-a7a4-285e8e451967 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:21.256978 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1dd8e0f0-abaf-4a1a-a7a4-285e8e451967 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:21.257402 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1dd8e0f0-abaf-4a1a-a7a4-285e8e451967 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:21.390607 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1dd8e0f0-abaf-4a1a-a7a4-285e8e451967 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:21.398548 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1dd8e0f0-abaf-4a1a-a7a4-285e8e451967 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1680 microversion: 2.1 time: 0.154460 Aug 08 14:35:21.399134 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 302/631] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:21 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:21.683949 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c22b9d93-780a-43ca-9767-11a44caf13bd tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:21.684481 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c22b9d93-780a-43ca-9767-11a44caf13bd tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:21.690820 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c22b9d93-780a-43ca-9767-11a44caf13bd tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:21.691339 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c22b9d93-780a-43ca-9767-11a44caf13bd tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:21.691773 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c22b9d93-780a-43ca-9767-11a44caf13bd tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:21.692458 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c22b9d93-780a-43ca-9767-11a44caf13bd tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:21.692917 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c22b9d93-780a-43ca-9767-11a44caf13bd tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:21.693334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c22b9d93-780a-43ca-9767-11a44caf13bd tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:21.823169 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c22b9d93-780a-43ca-9767-11a44caf13bd tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:21.830753 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c22b9d93-780a-43ca-9767-11a44caf13bd tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.150885 Aug 08 14:35:21.831371 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 330/632] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:21 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:22.097749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3768bc07-c7a1-4103-9153-bc63c4dd9037 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:22.098376 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3768bc07-c7a1-4103-9153-bc63c4dd9037 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:22.104451 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3768bc07-c7a1-4103-9153-bc63c4dd9037 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:22.104888 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3768bc07-c7a1-4103-9153-bc63c4dd9037 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:22.105323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3768bc07-c7a1-4103-9153-bc63c4dd9037 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:22.106011 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3768bc07-c7a1-4103-9153-bc63c4dd9037 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:22.106462 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3768bc07-c7a1-4103-9153-bc63c4dd9037 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:22.106887 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3768bc07-c7a1-4103-9153-bc63c4dd9037 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:22.168556 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3768bc07-c7a1-4103-9153-bc63c4dd9037 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:22.176022 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3768bc07-c7a1-4103-9153-bc63c4dd9037 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1255 microversion: 2.1 time: 0.082092 Aug 08 14:35:22.177436 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 303/633] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:22 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1255 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:22.420283 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d23340e3-cdb9-431d-880f-2d8bdf262f32 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:22.420954 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d23340e3-cdb9-431d-880f-2d8bdf262f32 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:22.427419 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d23340e3-cdb9-431d-880f-2d8bdf262f32 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:22.427900 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d23340e3-cdb9-431d-880f-2d8bdf262f32 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:22.428362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d23340e3-cdb9-431d-880f-2d8bdf262f32 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:22.429048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d23340e3-cdb9-431d-880f-2d8bdf262f32 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:22.429496 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d23340e3-cdb9-431d-880f-2d8bdf262f32 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:22.429921 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d23340e3-cdb9-431d-880f-2d8bdf262f32 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:22.561067 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d23340e3-cdb9-431d-880f-2d8bdf262f32 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:22.569107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d23340e3-cdb9-431d-880f-2d8bdf262f32 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1680 microversion: 2.1 time: 0.152750 Aug 08 14:35:22.569662 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 331/634] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:22 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:22.853667 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-cbed22d5-602a-4566-8ac7-3f375a1d8fe6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:22.854280 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-cbed22d5-602a-4566-8ac7-3f375a1d8fe6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:22.863685 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbed22d5-602a-4566-8ac7-3f375a1d8fe6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:22.864186 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbed22d5-602a-4566-8ac7-3f375a1d8fe6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:22.864629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbed22d5-602a-4566-8ac7-3f375a1d8fe6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:22.865925 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbed22d5-602a-4566-8ac7-3f375a1d8fe6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:22.866571 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbed22d5-602a-4566-8ac7-3f375a1d8fe6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:22.867017 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbed22d5-602a-4566-8ac7-3f375a1d8fe6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:23.015934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-cbed22d5-602a-4566-8ac7-3f375a1d8fe6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:23.027245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-cbed22d5-602a-4566-8ac7-3f375a1d8fe6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.177948 Aug 08 14:35:23.028293 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 304/635] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:22 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:23.200818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-eb6d4137-ac57-4a7e-b390-c018c08eb4ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:23.200818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-eb6d4137-ac57-4a7e-b390-c018c08eb4ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:23.213170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb6d4137-ac57-4a7e-b390-c018c08eb4ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:23.213667 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb6d4137-ac57-4a7e-b390-c018c08eb4ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:23.214099 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb6d4137-ac57-4a7e-b390-c018c08eb4ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:23.214858 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb6d4137-ac57-4a7e-b390-c018c08eb4ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:23.215396 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb6d4137-ac57-4a7e-b390-c018c08eb4ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:23.215829 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb6d4137-ac57-4a7e-b390-c018c08eb4ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:23.294408 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-eb6d4137-ac57-4a7e-b390-c018c08eb4ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:23.303693 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-eb6d4137-ac57-4a7e-b390-c018c08eb4ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1317 microversion: 2.1 time: 0.109366 Aug 08 14:35:23.304585 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 332/636] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:23 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1317 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:23.590492 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-df74f703-1002-4543-a15f-d4b26432a1c8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:23.591005 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-df74f703-1002-4543-a15f-d4b26432a1c8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:23.602338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-df74f703-1002-4543-a15f-d4b26432a1c8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:23.603071 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-df74f703-1002-4543-a15f-d4b26432a1c8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:23.603798 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-df74f703-1002-4543-a15f-d4b26432a1c8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:23.604916 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-df74f703-1002-4543-a15f-d4b26432a1c8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:23.607419 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-df74f703-1002-4543-a15f-d4b26432a1c8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:23.608157 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-df74f703-1002-4543-a15f-d4b26432a1c8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:23.822749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-df74f703-1002-4543-a15f-d4b26432a1c8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:23.834941 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-df74f703-1002-4543-a15f-d4b26432a1c8 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1680 microversion: 2.1 time: 0.248836 Aug 08 14:35:23.835757 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 305/637] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:23 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1680 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:24.051566 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-16a2089e-5fa5-4b8b-8607-4219c73329ed tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:24.052187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-16a2089e-5fa5-4b8b-8607-4219c73329ed tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:24.059300 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16a2089e-5fa5-4b8b-8607-4219c73329ed tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:24.059793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16a2089e-5fa5-4b8b-8607-4219c73329ed tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:24.060420 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16a2089e-5fa5-4b8b-8607-4219c73329ed tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:24.061170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16a2089e-5fa5-4b8b-8607-4219c73329ed tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:24.061588 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16a2089e-5fa5-4b8b-8607-4219c73329ed tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:24.062015 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16a2089e-5fa5-4b8b-8607-4219c73329ed tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:24.271008 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-16a2089e-5fa5-4b8b-8607-4219c73329ed tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:24.280254 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-16a2089e-5fa5-4b8b-8607-4219c73329ed tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.232610 Aug 08 14:35:24.281189 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 333/638] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:24 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:24.325492 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-17922cf3-5b52-410e-a677-83d9172db7d6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:24.326978 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-17922cf3-5b52-410e-a677-83d9172db7d6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:24.334116 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17922cf3-5b52-410e-a677-83d9172db7d6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:24.334900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17922cf3-5b52-410e-a677-83d9172db7d6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:24.335372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17922cf3-5b52-410e-a677-83d9172db7d6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:24.336145 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17922cf3-5b52-410e-a677-83d9172db7d6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:24.336938 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17922cf3-5b52-410e-a677-83d9172db7d6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:24.337561 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17922cf3-5b52-410e-a677-83d9172db7d6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:24.415378 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-17922cf3-5b52-410e-a677-83d9172db7d6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:24.426230 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-17922cf3-5b52-410e-a677-83d9172db7d6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1317 microversion: 2.1 time: 0.104601 Aug 08 14:35:24.440630 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 306/639] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:24 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1317 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:24.563368 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-7f4d247e-d896-4f86-a13a-8b51a3db4fea req-8d2981bf-cd6f-4c14-b984-deb9f1aa218c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c19ca8ed-1d03-4d63-9e99-900018554325", "name": "network-vif-deleted", "tag": "a6c756df-1afd-4d0a-a280-181227b91c9d"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:24.576477 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-7f4d247e-d896-4f86-a13a-8b51a3db4fea req-8d2981bf-cd6f-4c14-b984-deb9f1aa218c service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:24.577497 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-7f4d247e-d896-4f86-a13a-8b51a3db4fea req-8d2981bf-cd6f-4c14-b984-deb9f1aa218c service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:24.578125 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-7f4d247e-d896-4f86-a13a-8b51a3db4fea req-8d2981bf-cd6f-4c14-b984-deb9f1aa218c service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:24.592517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-7f4d247e-d896-4f86-a13a-8b51a3db4fea req-8d2981bf-cd6f-4c14-b984-deb9f1aa218c service nova] Creating event network-vif-deleted:a6c756df-1afd-4d0a-a280-181227b91c9d for instance c19ca8ed-1d03-4d63-9e99-900018554325 on hv-cinder-85200 Aug 08 14:35:24.598611 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-7f4d247e-d896-4f86-a13a-8b51a3db4fea req-8d2981bf-cd6f-4c14-b984-deb9f1aa218c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039073 Aug 08 14:35:24.600412 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 334/640] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:24.862103 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3c7090f2-7f58-4628-9f11-83f5b1d89cad tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:24.862785 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3c7090f2-7f58-4628-9f11-83f5b1d89cad tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:24.874121 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3c7090f2-7f58-4628-9f11-83f5b1d89cad tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:24.874613 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3c7090f2-7f58-4628-9f11-83f5b1d89cad tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:24.877593 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3c7090f2-7f58-4628-9f11-83f5b1d89cad tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:24.880010 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3c7090f2-7f58-4628-9f11-83f5b1d89cad tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:24.884021 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3c7090f2-7f58-4628-9f11-83f5b1d89cad tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:24.884685 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3c7090f2-7f58-4628-9f11-83f5b1d89cad tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:24.994744 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3c7090f2-7f58-4628-9f11-83f5b1d89cad tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:25.003175 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3c7090f2-7f58-4628-9f11-83f5b1d89cad tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1613 microversion: 2.1 time: 0.145215 Aug 08 14:35:25.004224 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 307/641] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:24 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1613 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:25.302885 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d7258347-1c49-4b2d-b4cf-85bed27f579a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:25.304006 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d7258347-1c49-4b2d-b4cf-85bed27f579a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:25.315462 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d7258347-1c49-4b2d-b4cf-85bed27f579a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:25.315961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d7258347-1c49-4b2d-b4cf-85bed27f579a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:25.316407 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d7258347-1c49-4b2d-b4cf-85bed27f579a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:25.317121 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d7258347-1c49-4b2d-b4cf-85bed27f579a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:25.317580 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d7258347-1c49-4b2d-b4cf-85bed27f579a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:25.318007 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d7258347-1c49-4b2d-b4cf-85bed27f579a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:25.455271 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2f06faf7-d37e-4a81-9b5a-b249132af187 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:25.456600 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2f06faf7-d37e-4a81-9b5a-b249132af187 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:25.470129 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f06faf7-d37e-4a81-9b5a-b249132af187 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:25.470790 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f06faf7-d37e-4a81-9b5a-b249132af187 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:25.472477 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f06faf7-d37e-4a81-9b5a-b249132af187 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:25.488357 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f06faf7-d37e-4a81-9b5a-b249132af187 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:25.488826 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f06faf7-d37e-4a81-9b5a-b249132af187 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:25.489267 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f06faf7-d37e-4a81-9b5a-b249132af187 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:25.545798 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d7258347-1c49-4b2d-b4cf-85bed27f579a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:25.572082 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d7258347-1c49-4b2d-b4cf-85bed27f579a tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.273875 Aug 08 14:35:25.587270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 335/642] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:25 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:25.757208 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2f06faf7-d37e-4a81-9b5a-b249132af187 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:25.766481 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2f06faf7-d37e-4a81-9b5a-b249132af187 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.321747 Aug 08 14:35:25.767850 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 308/643] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:25 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:26.024918 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2deaac99-ba3a-4a9b-a080-11a9dce66714 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:26.026090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2deaac99-ba3a-4a9b-a080-11a9dce66714 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:26.035887 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2deaac99-ba3a-4a9b-a080-11a9dce66714 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:26.036387 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2deaac99-ba3a-4a9b-a080-11a9dce66714 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:26.036821 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2deaac99-ba3a-4a9b-a080-11a9dce66714 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:26.037699 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2deaac99-ba3a-4a9b-a080-11a9dce66714 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:26.038313 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2deaac99-ba3a-4a9b-a080-11a9dce66714 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:26.038736 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2deaac99-ba3a-4a9b-a080-11a9dce66714 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:26.134237 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2deaac99-ba3a-4a9b-a080-11a9dce66714 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:26.141830 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2deaac99-ba3a-4a9b-a080-11a9dce66714 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1613 microversion: 2.1 time: 0.121341 Aug 08 14:35:26.142659 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 336/644] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:26 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1613 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:26.519161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-92ca3152-4dd0-4411-9a10-6dfd0d026b84 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:26.520326 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-92ca3152-4dd0-4411-9a10-6dfd0d026b84 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:26.528576 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-92ca3152-4dd0-4411-9a10-6dfd0d026b84 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:26.529446 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-92ca3152-4dd0-4411-9a10-6dfd0d026b84 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:26.530120 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-92ca3152-4dd0-4411-9a10-6dfd0d026b84 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:26.531204 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-92ca3152-4dd0-4411-9a10-6dfd0d026b84 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:26.531859 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-92ca3152-4dd0-4411-9a10-6dfd0d026b84 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:26.532284 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-92ca3152-4dd0-4411-9a10-6dfd0d026b84 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:26.535242 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:26.610148 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-81b4a79f-e015-47a1-899c-8ed8290e404c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:26.610777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-81b4a79f-e015-47a1-899c-8ed8290e404c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:26.624311 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-81b4a79f-e015-47a1-899c-8ed8290e404c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:26.625040 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-81b4a79f-e015-47a1-899c-8ed8290e404c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:26.625640 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-81b4a79f-e015-47a1-899c-8ed8290e404c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:26.626535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-81b4a79f-e015-47a1-899c-8ed8290e404c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:26.627209 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-81b4a79f-e015-47a1-899c-8ed8290e404c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:26.627820 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-81b4a79f-e015-47a1-899c-8ed8290e404c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:26.632915 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:26.651730 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-92ca3152-4dd0-4411-9a10-6dfd0d026b84 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lazy-loading 'services' on Instance uuid 61b75b2c-76ff-4530-9553-9fb04db7c082 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:35:26.759976 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-92ca3152-4dd0-4411-9a10-6dfd0d026b84 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "DELETE /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082/os-volume_attachments/7b9b2fcb-3343-4d68-afea-276ea2586007" status: 202 len: 0 microversion: 2.1 time: 0.244790 Aug 08 14:35:26.764297 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 309/645] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 14:35:26 2022] DELETE /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082/os-volume_attachments/7b9b2fcb-3343-4d68-afea-276ea2586007 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:35:26.796981 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-028186c2-fd44-41bb-afaa-1c4e91f53ec1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:26.798550 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-028186c2-fd44-41bb-afaa-1c4e91f53ec1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:26.809855 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-028186c2-fd44-41bb-afaa-1c4e91f53ec1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:26.810771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-028186c2-fd44-41bb-afaa-1c4e91f53ec1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:26.811717 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-028186c2-fd44-41bb-afaa-1c4e91f53ec1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:26.812709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-028186c2-fd44-41bb-afaa-1c4e91f53ec1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:26.813334 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-028186c2-fd44-41bb-afaa-1c4e91f53ec1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:26.813932 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-028186c2-fd44-41bb-afaa-1c4e91f53ec1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:26.830116 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-81b4a79f-e015-47a1-899c-8ed8290e404c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:26.839825 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-81b4a79f-e015-47a1-899c-8ed8290e404c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.233424 Aug 08 14:35:26.840404 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 337/646] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:26 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:27.000585 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-028186c2-fd44-41bb-afaa-1c4e91f53ec1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:27.012811 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-028186c2-fd44-41bb-afaa-1c4e91f53ec1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.225948 Aug 08 14:35:27.013843 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 310/647] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:26 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:27.165002 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4d0af1e0-9660-4c6e-aeac-def81d6e433e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:27.165902 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-4d0af1e0-9660-4c6e-aeac-def81d6e433e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:27.172453 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4d0af1e0-9660-4c6e-aeac-def81d6e433e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:27.172943 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4d0af1e0-9660-4c6e-aeac-def81d6e433e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:27.173432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4d0af1e0-9660-4c6e-aeac-def81d6e433e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:27.174136 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4d0af1e0-9660-4c6e-aeac-def81d6e433e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:27.174593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4d0af1e0-9660-4c6e-aeac-def81d6e433e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:27.175016 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4d0af1e0-9660-4c6e-aeac-def81d6e433e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:27.239880 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4d0af1e0-9660-4c6e-aeac-def81d6e433e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:27.247718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-4d0af1e0-9660-4c6e-aeac-def81d6e433e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1613 microversion: 2.1 time: 0.087514 Aug 08 14:35:27.248348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 338/648] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:27 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:27.480777 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-92046af7-7601-4b6a-aed8-b4cc672abe3f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:27.481555 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-92046af7-7601-4b6a-aed8-b4cc672abe3f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:27.487910 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-92046af7-7601-4b6a-aed8-b4cc672abe3f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:27.488387 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-92046af7-7601-4b6a-aed8-b4cc672abe3f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:27.488814 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-92046af7-7601-4b6a-aed8-b4cc672abe3f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:27.489506 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-92046af7-7601-4b6a-aed8-b4cc672abe3f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:27.490001 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-92046af7-7601-4b6a-aed8-b4cc672abe3f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:27.490407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-92046af7-7601-4b6a-aed8-b4cc672abe3f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:27.521021 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-92046af7-7601-4b6a-aed8-b4cc672abe3f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments/1f0d9763-b93e-42ee-8a50-7e37eb7efa76" status: 200 len: 194 microversion: 2.20 time: 0.044497 Aug 08 14:35:27.522319 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 311/649] 10.222.0.50 () {60 vars in 1454 bytes} [Mon Aug 8 14:35:27 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments/1f0d9763-b93e-42ee-8a50-7e37eb7efa76 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:35:27.597923 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c1e5a460-85ce-41a2-88ae-c27f4cb1b056 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:27.598823 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c1e5a460-85ce-41a2-88ae-c27f4cb1b056 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:27.607391 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c1e5a460-85ce-41a2-88ae-c27f4cb1b056 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:27.608140 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c1e5a460-85ce-41a2-88ae-c27f4cb1b056 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:27.608573 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c1e5a460-85ce-41a2-88ae-c27f4cb1b056 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:27.609278 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c1e5a460-85ce-41a2-88ae-c27f4cb1b056 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:27.609761 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c1e5a460-85ce-41a2-88ae-c27f4cb1b056 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:27.610345 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c1e5a460-85ce-41a2-88ae-c27f4cb1b056 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:27.697637 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-c1e5a460-85ce-41a2-88ae-c27f4cb1b056 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lazy-loading 'services' on Instance uuid fd0245e7-b0d0-4fbe-a233-4b3e7768b94c {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:35:27.782804 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c1e5a460-85ce-41a2-88ae-c27f4cb1b056 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments/1f0d9763-b93e-42ee-8a50-7e37eb7efa76" status: 202 len: 0 microversion: 2.20 time: 0.192881 Aug 08 14:35:27.783442 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 339/650] 10.222.0.50 () {60 vars in 1457 bytes} [Mon Aug 8 14:35:27 2022] DELETE /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments/1f0d9763-b93e-42ee-8a50-7e37eb7efa76 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:35:27.792618 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-15e58b1d-94a7-4dd1-a607-28bd38b3bd53 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:27.794841 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-15e58b1d-94a7-4dd1-a607-28bd38b3bd53 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:27.801492 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15e58b1d-94a7-4dd1-a607-28bd38b3bd53 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:27.802047 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15e58b1d-94a7-4dd1-a607-28bd38b3bd53 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:27.802991 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15e58b1d-94a7-4dd1-a607-28bd38b3bd53 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:27.803731 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15e58b1d-94a7-4dd1-a607-28bd38b3bd53 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:27.804182 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15e58b1d-94a7-4dd1-a607-28bd38b3bd53 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:27.804599 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15e58b1d-94a7-4dd1-a607-28bd38b3bd53 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:27.892836 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2fffc9ee-3c5e-4c84-8b2e-d95c840aa700 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:27.895595 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2fffc9ee-3c5e-4c84-8b2e-d95c840aa700 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:27.904667 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fffc9ee-3c5e-4c84-8b2e-d95c840aa700 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:27.905546 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fffc9ee-3c5e-4c84-8b2e-d95c840aa700 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:27.906242 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fffc9ee-3c5e-4c84-8b2e-d95c840aa700 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:27.907361 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fffc9ee-3c5e-4c84-8b2e-d95c840aa700 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:27.908258 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fffc9ee-3c5e-4c84-8b2e-d95c840aa700 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:27.908925 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fffc9ee-3c5e-4c84-8b2e-d95c840aa700 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:27.933860 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-15e58b1d-94a7-4dd1-a607-28bd38b3bd53 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145357 Aug 08 14:35:27.938573 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 312/651] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Aug 8 14:35:27 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:35:28.037473 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e5727e55-a0cc-4597-a461-c25ebd8e14b7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:28.038790 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e5727e55-a0cc-4597-a461-c25ebd8e14b7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:28.045250 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5727e55-a0cc-4597-a461-c25ebd8e14b7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:28.045747 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5727e55-a0cc-4597-a461-c25ebd8e14b7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:28.046183 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5727e55-a0cc-4597-a461-c25ebd8e14b7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:28.046893 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5727e55-a0cc-4597-a461-c25ebd8e14b7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:28.047369 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5727e55-a0cc-4597-a461-c25ebd8e14b7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:28.047797 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5727e55-a0cc-4597-a461-c25ebd8e14b7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:28.091517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2fffc9ee-3c5e-4c84-8b2e-d95c840aa700 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:28.102018 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2fffc9ee-3c5e-4c84-8b2e-d95c840aa700 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.239983 Aug 08 14:35:28.103017 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 340/652] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:27 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:28.200678 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e5727e55-a0cc-4597-a461-c25ebd8e14b7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:28.208680 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e5727e55-a0cc-4597-a461-c25ebd8e14b7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.175916 Aug 08 14:35:28.209799 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 313/653] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:28 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:28.269237 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1bbfd4dd-1f58-41a2-adde-6bda2f17818d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:28.269895 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1bbfd4dd-1f58-41a2-adde-6bda2f17818d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:28.276622 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1bbfd4dd-1f58-41a2-adde-6bda2f17818d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:28.277212 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1bbfd4dd-1f58-41a2-adde-6bda2f17818d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:28.277551 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1bbfd4dd-1f58-41a2-adde-6bda2f17818d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:28.278255 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1bbfd4dd-1f58-41a2-adde-6bda2f17818d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:28.278805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1bbfd4dd-1f58-41a2-adde-6bda2f17818d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:28.279173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1bbfd4dd-1f58-41a2-adde-6bda2f17818d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:28.343113 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-1bbfd4dd-1f58-41a2-adde-6bda2f17818d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:28.351447 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1bbfd4dd-1f58-41a2-adde-6bda2f17818d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1613 microversion: 2.1 time: 0.086351 Aug 08 14:35:28.352412 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 341/654] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:28 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1613 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:28.946141 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-740a7ebc-6bef-4757-a59b-0517c471fb8e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:28.948301 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-740a7ebc-6bef-4757-a59b-0517c471fb8e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:28.955165 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-740a7ebc-6bef-4757-a59b-0517c471fb8e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:28.955674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-740a7ebc-6bef-4757-a59b-0517c471fb8e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:28.956105 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-740a7ebc-6bef-4757-a59b-0517c471fb8e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:28.956874 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-740a7ebc-6bef-4757-a59b-0517c471fb8e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:28.957336 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-740a7ebc-6bef-4757-a59b-0517c471fb8e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:28.957941 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-740a7ebc-6bef-4757-a59b-0517c471fb8e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:28.989228 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-740a7ebc-6bef-4757-a59b-0517c471fb8e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047038 Aug 08 14:35:28.990053 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 314/655] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Aug 8 14:35:28 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:35:29.122634 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-72d64143-9174-44f7-b6b9-4ebfeb6fa657 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:29.123505 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-72d64143-9174-44f7-b6b9-4ebfeb6fa657 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:29.130148 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-72d64143-9174-44f7-b6b9-4ebfeb6fa657 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:29.130744 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-72d64143-9174-44f7-b6b9-4ebfeb6fa657 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:29.131280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-72d64143-9174-44f7-b6b9-4ebfeb6fa657 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:29.132041 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-72d64143-9174-44f7-b6b9-4ebfeb6fa657 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:29.132710 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-72d64143-9174-44f7-b6b9-4ebfeb6fa657 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:29.133413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-72d64143-9174-44f7-b6b9-4ebfeb6fa657 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:29.230355 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7b1bb473-a7bc-470e-9121-3087e6d65358 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:29.231475 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7b1bb473-a7bc-470e-9121-3087e6d65358 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:29.238304 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7b1bb473-a7bc-470e-9121-3087e6d65358 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:29.239145 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7b1bb473-a7bc-470e-9121-3087e6d65358 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:29.239790 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7b1bb473-a7bc-470e-9121-3087e6d65358 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:29.241373 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7b1bb473-a7bc-470e-9121-3087e6d65358 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:29.241901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7b1bb473-a7bc-470e-9121-3087e6d65358 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:29.242567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7b1bb473-a7bc-470e-9121-3087e6d65358 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:29.337656 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-72d64143-9174-44f7-b6b9-4ebfeb6fa657 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:29.351961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-72d64143-9174-44f7-b6b9-4ebfeb6fa657 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.233139 Aug 08 14:35:29.352786 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 342/656] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:29 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:29.372051 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-035a3c45-953c-4647-a5f1-b264824450f4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:29.372753 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-035a3c45-953c-4647-a5f1-b264824450f4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:29.378773 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-035a3c45-953c-4647-a5f1-b264824450f4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:29.379352 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-035a3c45-953c-4647-a5f1-b264824450f4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:29.380028 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-035a3c45-953c-4647-a5f1-b264824450f4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:29.381554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-035a3c45-953c-4647-a5f1-b264824450f4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:29.382017 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-035a3c45-953c-4647-a5f1-b264824450f4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:29.382548 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-035a3c45-953c-4647-a5f1-b264824450f4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:29.416652 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7b1bb473-a7bc-470e-9121-3087e6d65358 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:29.425567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7b1bb473-a7bc-470e-9121-3087e6d65358 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.199015 Aug 08 14:35:29.426478 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 315/657] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:29 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:29.464681 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-035a3c45-953c-4647-a5f1-b264824450f4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:29.472643 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-035a3c45-953c-4647-a5f1-b264824450f4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1613 microversion: 2.1 time: 0.104375 Aug 08 14:35:29.473300 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 343/658] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:29 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1613 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:30.002418 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4b2a681d-3033-4334-8c07-a47f0511b276 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:30.004602 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4b2a681d-3033-4334-8c07-a47f0511b276 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:30.007072 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:30.016203 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b2a681d-3033-4334-8c07-a47f0511b276 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:30.016203 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b2a681d-3033-4334-8c07-a47f0511b276 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:30.016203 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b2a681d-3033-4334-8c07-a47f0511b276 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:30.016203 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b2a681d-3033-4334-8c07-a47f0511b276 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:30.016677 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b2a681d-3033-4334-8c07-a47f0511b276 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:30.017007 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b2a681d-3033-4334-8c07-a47f0511b276 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:30.048885 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4b2a681d-3033-4334-8c07-a47f0511b276 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050466 Aug 08 14:35:30.049449 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 316/659] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Aug 8 14:35:29 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:35:30.374246 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6c770919-6b01-4d10-a8d8-9ae9838c477d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:30.374964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6c770919-6b01-4d10-a8d8-9ae9838c477d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:30.377304 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:30.378260 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=10 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:30.391957 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c770919-6b01-4d10-a8d8-9ae9838c477d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:30.395496 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c770919-6b01-4d10-a8d8-9ae9838c477d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:30.395496 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c770919-6b01-4d10-a8d8-9ae9838c477d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:30.395496 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c770919-6b01-4d10-a8d8-9ae9838c477d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:30.395496 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c770919-6b01-4d10-a8d8-9ae9838c477d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:30.395959 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c770919-6b01-4d10-a8d8-9ae9838c477d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:30.448875 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6b92918e-fcb8-4cbe-844d-663fa6b84345 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:30.449510 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6b92918e-fcb8-4cbe-844d-663fa6b84345 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:30.456594 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6b92918e-fcb8-4cbe-844d-663fa6b84345 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:30.457493 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6b92918e-fcb8-4cbe-844d-663fa6b84345 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:30.458239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6b92918e-fcb8-4cbe-844d-663fa6b84345 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:30.459914 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6b92918e-fcb8-4cbe-844d-663fa6b84345 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:30.460570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6b92918e-fcb8-4cbe-844d-663fa6b84345 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:30.461339 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6b92918e-fcb8-4cbe-844d-663fa6b84345 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:30.634250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6c770919-6b01-4d10-a8d8-9ae9838c477d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:30.642059 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6c770919-6b01-4d10-a8d8-9ae9838c477d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.271979 Aug 08 14:35:30.642840 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 344/660] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:30 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:30.648709 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8703bfa9-1f23-45bc-8dde-7fd53bd9bd50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:30.649318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8703bfa9-1f23-45bc-8dde-7fd53bd9bd50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:30.663965 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8703bfa9-1f23-45bc-8dde-7fd53bd9bd50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:30.666342 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8703bfa9-1f23-45bc-8dde-7fd53bd9bd50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:30.666940 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8703bfa9-1f23-45bc-8dde-7fd53bd9bd50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:30.667830 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8703bfa9-1f23-45bc-8dde-7fd53bd9bd50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:30.668499 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8703bfa9-1f23-45bc-8dde-7fd53bd9bd50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:30.669187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8703bfa9-1f23-45bc-8dde-7fd53bd9bd50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:30.681631 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6b92918e-fcb8-4cbe-844d-663fa6b84345 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:30.689758 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6b92918e-fcb8-4cbe-844d-663fa6b84345 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.244673 Aug 08 14:35:30.690557 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 317/661] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:30 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:30.749432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8703bfa9-1f23-45bc-8dde-7fd53bd9bd50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:30.757854 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8703bfa9-1f23-45bc-8dde-7fd53bd9bd50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1613 microversion: 2.1 time: 0.114105 Aug 08 14:35:30.758548 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 345/662] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:30 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:31.061559 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-30b81482-6d87-43d1-9cf8-251ae6d995fe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:31.063659 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-30b81482-6d87-43d1-9cf8-251ae6d995fe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:31.070602 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-30b81482-6d87-43d1-9cf8-251ae6d995fe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:31.071068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-30b81482-6d87-43d1-9cf8-251ae6d995fe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:31.071518 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-30b81482-6d87-43d1-9cf8-251ae6d995fe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:31.072196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-30b81482-6d87-43d1-9cf8-251ae6d995fe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:31.072644 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-30b81482-6d87-43d1-9cf8-251ae6d995fe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:31.073060 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-30b81482-6d87-43d1-9cf8-251ae6d995fe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:31.103646 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-30b81482-6d87-43d1-9cf8-251ae6d995fe tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046164 Aug 08 14:35:31.104439 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 318/663] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Aug 8 14:35:31 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:35:31.665968 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bac38ced-616d-48cc-8197-a76a5a9e5775 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:31.667306 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bac38ced-616d-48cc-8197-a76a5a9e5775 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:31.673930 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bac38ced-616d-48cc-8197-a76a5a9e5775 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:31.674425 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bac38ced-616d-48cc-8197-a76a5a9e5775 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:31.674868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bac38ced-616d-48cc-8197-a76a5a9e5775 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:31.675607 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bac38ced-616d-48cc-8197-a76a5a9e5775 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:31.676070 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bac38ced-616d-48cc-8197-a76a5a9e5775 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:31.676501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bac38ced-616d-48cc-8197-a76a5a9e5775 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:31.710338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4cd79141-1066-4dba-9405-deb2aa2fb5cc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:31.711434 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4cd79141-1066-4dba-9405-deb2aa2fb5cc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:31.717709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4cd79141-1066-4dba-9405-deb2aa2fb5cc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:31.718271 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4cd79141-1066-4dba-9405-deb2aa2fb5cc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:31.718777 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4cd79141-1066-4dba-9405-deb2aa2fb5cc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:31.719623 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4cd79141-1066-4dba-9405-deb2aa2fb5cc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:31.720147 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4cd79141-1066-4dba-9405-deb2aa2fb5cc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:31.720607 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4cd79141-1066-4dba-9405-deb2aa2fb5cc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:31.879246 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bac38ced-616d-48cc-8197-a76a5a9e5775 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:31.888963 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bac38ced-616d-48cc-8197-a76a5a9e5775 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.227804 Aug 08 14:35:31.889657 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 346/664] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:31 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:31.903076 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4033bc88-d529-4700-9f63-00fa7b935040 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:31.903076 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-4033bc88-d529-4700-9f63-00fa7b935040 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:31.904140 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4033bc88-d529-4700-9f63-00fa7b935040 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:31.904636 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4033bc88-d529-4700-9f63-00fa7b935040 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:31.905075 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4033bc88-d529-4700-9f63-00fa7b935040 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:31.905787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4033bc88-d529-4700-9f63-00fa7b935040 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:31.906246 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4033bc88-d529-4700-9f63-00fa7b935040 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:31.906729 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4033bc88-d529-4700-9f63-00fa7b935040 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:31.921568 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4cd79141-1066-4dba-9405-deb2aa2fb5cc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:31.929841 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4cd79141-1066-4dba-9405-deb2aa2fb5cc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.223514 Aug 08 14:35:31.930347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 319/665] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:31 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:31.972399 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4033bc88-d529-4700-9f63-00fa7b935040 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:31.981030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-4033bc88-d529-4700-9f63-00fa7b935040 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1613 microversion: 2.1 time: 0.090344 Aug 08 14:35:31.981652 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 347/666] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:31 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:32.116139 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-930c7e14-89e0-46d1-bba0-b0553853380e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:32.118243 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-930c7e14-89e0-46d1-bba0-b0553853380e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:32.124773 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-930c7e14-89e0-46d1-bba0-b0553853380e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:32.125248 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-930c7e14-89e0-46d1-bba0-b0553853380e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:32.125673 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-930c7e14-89e0-46d1-bba0-b0553853380e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:32.126368 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-930c7e14-89e0-46d1-bba0-b0553853380e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:32.127025 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-930c7e14-89e0-46d1-bba0-b0553853380e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:32.127742 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-930c7e14-89e0-46d1-bba0-b0553853380e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:32.161733 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-930c7e14-89e0-46d1-bba0-b0553853380e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049490 Aug 08 14:35:32.162421 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 320/667] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Aug 8 14:35:32 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:35:32.909840 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-741897ce-7be5-4cb0-916b-69e791e74a5c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:32.910559 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-741897ce-7be5-4cb0-916b-69e791e74a5c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:32.918112 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-741897ce-7be5-4cb0-916b-69e791e74a5c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:32.918599 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-741897ce-7be5-4cb0-916b-69e791e74a5c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:32.919029 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-741897ce-7be5-4cb0-916b-69e791e74a5c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:32.919760 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-741897ce-7be5-4cb0-916b-69e791e74a5c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:32.920208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-741897ce-7be5-4cb0-916b-69e791e74a5c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:32.920665 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-741897ce-7be5-4cb0-916b-69e791e74a5c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:32.949863 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3912c059-22e7-461c-a476-cf5d6d959619 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:32.950479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3912c059-22e7-461c-a476-cf5d6d959619 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:32.956609 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3912c059-22e7-461c-a476-cf5d6d959619 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:32.957093 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3912c059-22e7-461c-a476-cf5d6d959619 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:32.957531 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3912c059-22e7-461c-a476-cf5d6d959619 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:32.958236 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3912c059-22e7-461c-a476-cf5d6d959619 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:32.959420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3912c059-22e7-461c-a476-cf5d6d959619 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:32.959907 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3912c059-22e7-461c-a476-cf5d6d959619 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:33.103794 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-741897ce-7be5-4cb0-916b-69e791e74a5c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:33.111225 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-741897ce-7be5-4cb0-916b-69e791e74a5c tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1675 microversion: 2.1 time: 0.205291 Aug 08 14:35:33.112262 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 348/668] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:32 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1675 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:33.116791 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-99e8b706-6cee-4309-9040-add161c1ee7a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:33.117394 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-99e8b706-6cee-4309-9040-add161c1ee7a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:33.123349 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-99e8b706-6cee-4309-9040-add161c1ee7a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:33.124107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-99e8b706-6cee-4309-9040-add161c1ee7a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:33.124304 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-99e8b706-6cee-4309-9040-add161c1ee7a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:33.124962 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-99e8b706-6cee-4309-9040-add161c1ee7a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:33.125416 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-99e8b706-6cee-4309-9040-add161c1ee7a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:33.125846 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-99e8b706-6cee-4309-9040-add161c1ee7a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:33.131843 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3912c059-22e7-461c-a476-cf5d6d959619 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:33.139077 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3912c059-22e7-461c-a476-cf5d6d959619 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.193002 Aug 08 14:35:33.139744 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 321/669] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:32 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:33.175271 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f5223766-5489-4746-af18-5ff136ecc548 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:33.178051 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f5223766-5489-4746-af18-5ff136ecc548 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:33.184187 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5223766-5489-4746-af18-5ff136ecc548 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:33.184746 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5223766-5489-4746-af18-5ff136ecc548 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:33.185276 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5223766-5489-4746-af18-5ff136ecc548 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:33.186004 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5223766-5489-4746-af18-5ff136ecc548 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:33.186519 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5223766-5489-4746-af18-5ff136ecc548 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:33.187069 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5223766-5489-4746-af18-5ff136ecc548 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:33.189363 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-99e8b706-6cee-4309-9040-add161c1ee7a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:33.197533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-99e8b706-6cee-4309-9040-add161c1ee7a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1613 microversion: 2.1 time: 0.084786 Aug 08 14:35:33.198371 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 349/670] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:33 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:33.218348 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f5223766-5489-4746-af18-5ff136ecc548 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047049 Aug 08 14:35:33.218931 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 322/671] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Aug 8 14:35:33 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 14:35:34.134854 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-69bb3ec7-704c-4ab4-97ce-803327027284 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:34.135499 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-69bb3ec7-704c-4ab4-97ce-803327027284 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:34.143732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-69bb3ec7-704c-4ab4-97ce-803327027284 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:34.144209 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-69bb3ec7-704c-4ab4-97ce-803327027284 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:34.145236 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-69bb3ec7-704c-4ab4-97ce-803327027284 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:34.146871 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-69bb3ec7-704c-4ab4-97ce-803327027284 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:34.147619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-69bb3ec7-704c-4ab4-97ce-803327027284 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:34.147865 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-69bb3ec7-704c-4ab4-97ce-803327027284 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:34.154040 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-bbc8258b-8742-4996-9935-0d4938140ef8 req-392e3eba-5f20-4cc0-b14f-fddbe728a600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7117df5-9606-4392-a933-e624f6e97e2e", "tag": "d8539c0a-5ff5-4ee6-883f-9961bff24df3"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:34.168468 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-bbc8258b-8742-4996-9935-0d4938140ef8 req-392e3eba-5f20-4cc0-b14f-fddbe728a600 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:34.169295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-bbc8258b-8742-4996-9935-0d4938140ef8 req-392e3eba-5f20-4cc0-b14f-fddbe728a600 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:34.170878 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-bbc8258b-8742-4996-9935-0d4938140ef8 req-392e3eba-5f20-4cc0-b14f-fddbe728a600 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:34.184372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-bbc8258b-8742-4996-9935-0d4938140ef8 req-392e3eba-5f20-4cc0-b14f-fddbe728a600 service nova] Creating event network-changed:d8539c0a-5ff5-4ee6-883f-9961bff24df3 for instance a7117df5-9606-4392-a933-e624f6e97e2e on hv-cinder-85200 Aug 08 14:35:34.189903 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-bbc8258b-8742-4996-9935-0d4938140ef8 req-392e3eba-5f20-4cc0-b14f-fddbe728a600 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039323 Aug 08 14:35:34.191224 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 323/672] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:34.198788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-445a2567-1b9f-477f-9e58-d84fa5214307 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:34.199854 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-445a2567-1b9f-477f-9e58-d84fa5214307 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:34.209801 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-445a2567-1b9f-477f-9e58-d84fa5214307 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:34.210653 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-445a2567-1b9f-477f-9e58-d84fa5214307 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:34.211862 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-445a2567-1b9f-477f-9e58-d84fa5214307 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:34.212946 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-445a2567-1b9f-477f-9e58-d84fa5214307 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:34.213603 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-445a2567-1b9f-477f-9e58-d84fa5214307 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:34.214227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-445a2567-1b9f-477f-9e58-d84fa5214307 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:34.365892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-69bb3ec7-704c-4ab4-97ce-803327027284 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:34.373482 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-69bb3ec7-704c-4ab4-97ce-803327027284 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1652 microversion: 2.1 time: 0.243955 Aug 08 14:35:34.374070 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 350/673] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:34 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1652 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:34.378525 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0c3cbc5a-d569-4d4a-83b1-0a627427216e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:34.379390 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-0c3cbc5a-d569-4d4a-83b1-0a627427216e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:34.385648 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c3cbc5a-d569-4d4a-83b1-0a627427216e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:34.386303 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c3cbc5a-d569-4d4a-83b1-0a627427216e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:34.386744 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c3cbc5a-d569-4d4a-83b1-0a627427216e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:34.387527 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c3cbc5a-d569-4d4a-83b1-0a627427216e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:34.387989 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c3cbc5a-d569-4d4a-83b1-0a627427216e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:34.388407 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c3cbc5a-d569-4d4a-83b1-0a627427216e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:34.396677 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-445a2567-1b9f-477f-9e58-d84fa5214307 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:34.404484 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-445a2567-1b9f-477f-9e58-d84fa5214307 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.211867 Aug 08 14:35:34.405158 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 324/674] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:34 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:34.409902 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e210b8fa-faf9-44e3-b884-c4904905cf73 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:34.412271 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e210b8fa-faf9-44e3-b884-c4904905cf73 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:34.418995 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e210b8fa-faf9-44e3-b884-c4904905cf73 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:34.419519 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e210b8fa-faf9-44e3-b884-c4904905cf73 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:34.419956 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e210b8fa-faf9-44e3-b884-c4904905cf73 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:34.420316 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c3cbc5a-d569-4d4a-83b1-0a627427216e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:34.420658 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e210b8fa-faf9-44e3-b884-c4904905cf73 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:34.420797 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c3cbc5a-d569-4d4a-83b1-0a627427216e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:34.421114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e210b8fa-faf9-44e3-b884-c4904905cf73 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:34.421277 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c3cbc5a-d569-4d4a-83b1-0a627427216e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:34.421539 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e210b8fa-faf9-44e3-b884-c4904905cf73 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:34.421784 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-0c3cbc5a-d569-4d4a-83b1-0a627427216e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lazy-loading 'fault' on Instance uuid c19ca8ed-1d03-4d63-9e99-900018554325 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:35:34.447590 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:34.453099 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e210b8fa-faf9-44e3-b884-c4904905cf73 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046897 Aug 08 14:35:34.453683 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 325/675] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Aug 8 14:35:34 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:35:34.459622 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7214515d-518a-4eaf-af0a-847ce923d7ee tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:34.464983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-0c3cbc5a-d569-4d4a-83b1-0a627427216e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:34.465904 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7214515d-518a-4eaf-af0a-847ce923d7ee tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:34.466397 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7214515d-518a-4eaf-af0a-847ce923d7ee tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:34.466840 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7214515d-518a-4eaf-af0a-847ce923d7ee tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:34.472615 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0c3cbc5a-d569-4d4a-83b1-0a627427216e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 200 len: 1332 microversion: 2.1 time: 0.097595 Aug 08 14:35:34.473178 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 351/676] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:34 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:34.492735 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7214515d-518a-4eaf-af0a-847ce923d7ee tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Going to try to start instance {{(pid=118060) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 14:35:34.535168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7214515d-518a-4eaf-af0a-847ce923d7ee tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "POST /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/action" status: 202 len: 0 microversion: 2.1 time: 0.080229 Aug 08 14:35:34.535776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 326/677] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 14:35:34 2022] POST /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:35:34.544048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2f9040d0-9030-4e40-9060-c99d9ee0cbc1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:34.544651 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2f9040d0-9030-4e40-9060-c99d9ee0cbc1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:34.550479 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2f9040d0-9030-4e40-9060-c99d9ee0cbc1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:34.550954 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2f9040d0-9030-4e40-9060-c99d9ee0cbc1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:34.551416 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2f9040d0-9030-4e40-9060-c99d9ee0cbc1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:34.552111 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2f9040d0-9030-4e40-9060-c99d9ee0cbc1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:34.553043 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2f9040d0-9030-4e40-9060-c99d9ee0cbc1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:34.553470 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2f9040d0-9030-4e40-9060-c99d9ee0cbc1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:34.747365 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2f9040d0-9030-4e40-9060-c99d9ee0cbc1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:34.751079 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:34.757129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2f9040d0-9030-4e40-9060-c99d9ee0cbc1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1661 microversion: 2.1 time: 0.216775 Aug 08 14:35:34.759073 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 352/678] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:34 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1661 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:35.425058 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1fe1b4a6-83d7-4b04-af61-69a40be6365d tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:35.426463 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1fe1b4a6-83d7-4b04-af61-69a40be6365d tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:35.434335 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fe1b4a6-83d7-4b04-af61-69a40be6365d tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:35.434824 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fe1b4a6-83d7-4b04-af61-69a40be6365d tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:35.435303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fe1b4a6-83d7-4b04-af61-69a40be6365d tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:35.436012 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fe1b4a6-83d7-4b04-af61-69a40be6365d tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:35.436508 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fe1b4a6-83d7-4b04-af61-69a40be6365d tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:35.436945 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fe1b4a6-83d7-4b04-af61-69a40be6365d tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:35.466964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-814b32b4-8af7-4b44-9f9b-90827ed5a0e6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:35.469392 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-814b32b4-8af7-4b44-9f9b-90827ed5a0e6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:35.479524 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-814b32b4-8af7-4b44-9f9b-90827ed5a0e6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:35.480093 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-814b32b4-8af7-4b44-9f9b-90827ed5a0e6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:35.480587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-814b32b4-8af7-4b44-9f9b-90827ed5a0e6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:35.481482 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-814b32b4-8af7-4b44-9f9b-90827ed5a0e6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:35.481930 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-814b32b4-8af7-4b44-9f9b-90827ed5a0e6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:35.482501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-814b32b4-8af7-4b44-9f9b-90827ed5a0e6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:35.516373 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-814b32b4-8af7-4b44-9f9b-90827ed5a0e6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054191 Aug 08 14:35:35.516942 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 353/679] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Aug 8 14:35:35 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:35.522449 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-df3da1e8-39cf-4755-bed8-a4f270d342fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:35.523189 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-df3da1e8-39cf-4755-bed8-a4f270d342fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:35.526260 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:35.530473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-df3da1e8-39cf-4755-bed8-a4f270d342fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:35.530963 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-df3da1e8-39cf-4755-bed8-a4f270d342fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:35.531432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-df3da1e8-39cf-4755-bed8-a4f270d342fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:35.532450 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-df3da1e8-39cf-4755-bed8-a4f270d342fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:35.532891 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-df3da1e8-39cf-4755-bed8-a4f270d342fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:35.533307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-df3da1e8-39cf-4755-bed8-a4f270d342fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:35.550213 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-df3da1e8-39cf-4755-bed8-a4f270d342fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] HTTP exception thrown: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-df3da1e8-39cf-4755-bed8-a4f270d342fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Request method failure captured: Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 HTTP/1.1 Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4nDHzBnzio2VZ6ciHSRMNEEHFIYRjyMTvKRDfIH2F_niI0FcU0ZqBeBBZkKpUdHOb90TorX284g0qMdisJyL77Y3j06R-x49-mqWZufa0BFWwlg29tIQoalg1p609ZLEly-KDP4mLoxCO4eWlqZVpPuU5-IPf0H50niq4AklVZ208 Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:35:35.551993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:35:35.553487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc86120e53145328dd430f542e73182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc86120e53145328dd430f542e73182", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}] Aug 08 14:35:35.553487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:35:35.553487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:35:35.553487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:35:35.553487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:35:35.553487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:35:35.553487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:35:35.553487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 48a91f6797cc4604ba2606e0549234d0 Aug 08 14:35:35.553487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:35:35.553487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:35:35.553487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:35:35.553487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': 'c19ca8ed-1d03-4d63-9e99-900018554325'} Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:35:35.554334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:35:35.555732 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:35.556906 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-df3da1e8-39cf-4755-bed8-a4f270d342fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Returning 404 to user: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:35:35.556906 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-df3da1e8-39cf-4755-bed8-a4f270d342fd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 404 len: 111 microversion: 2.1 time: 0.035571 Aug 08 14:35:35.556906 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 354/680] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:35 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:35:35.562525 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-60e9cf17-070d-4c18-be8e-8e79fced72bc tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '.version_select at 0x7f9cb2550af0>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:35.595933 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-60e9cf17-070d-4c18-be8e-8e79fced72bc tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234128508" status: 202 len: 0 microversion: 2.1 time: 0.037030 Aug 08 14:35:35.596633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 355/681] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Aug 8 14:35:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234128508 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 14:35:35.602299 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1fe1b4a6-83d7-4b04-af61-69a40be6365d tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:35.603021 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-eae07690-cb14-4534-a19f-d0d659038799 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:35.603545 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-eae07690-cb14-4534-a19f-d0d659038799 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:35.610096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1fe1b4a6-83d7-4b04-af61-69a40be6365d tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.189345 Aug 08 14:35:35.610313 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eae07690-cb14-4534-a19f-d0d659038799 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:35.610678 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eae07690-cb14-4534-a19f-d0d659038799 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:35.611158 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 327/682] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:35 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:35.611521 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eae07690-cb14-4534-a19f-d0d659038799 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:35.612295 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eae07690-cb14-4534-a19f-d0d659038799 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:35.612758 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eae07690-cb14-4534-a19f-d0d659038799 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:35.613183 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eae07690-cb14-4534-a19f-d0d659038799 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:35.651425 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-eae07690-cb14-4534-a19f-d0d659038799 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Going to try to terminate instance {{(pid=118062) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:35:35.739935 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-eae07690-cb14-4534-a19f-d0d659038799 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 204 len: 0 microversion: 2.20 time: 0.141967 Aug 08 14:35:35.740522 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 356/683] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Aug 8 14:35:35 2022] DELETE /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 14:35:35.749907 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c7c809e0-866a-410e-a9ea-d413ae8a8c2f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:35.750534 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c7c809e0-866a-410e-a9ea-d413ae8a8c2f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:35.757288 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7c809e0-866a-410e-a9ea-d413ae8a8c2f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:35.757998 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7c809e0-866a-410e-a9ea-d413ae8a8c2f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:35.758442 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7c809e0-866a-410e-a9ea-d413ae8a8c2f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:35.759241 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7c809e0-866a-410e-a9ea-d413ae8a8c2f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:35.759704 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7c809e0-866a-410e-a9ea-d413ae8a8c2f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:35.760133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c7c809e0-866a-410e-a9ea-d413ae8a8c2f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:35.792147 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-98f73273-b8ce-49ae-84f3-b491eb0917a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:35.794256 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-98f73273-b8ce-49ae-84f3-b491eb0917a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:35.808848 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-98f73273-b8ce-49ae-84f3-b491eb0917a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:35.811977 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-98f73273-b8ce-49ae-84f3-b491eb0917a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:35.813481 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-98f73273-b8ce-49ae-84f3-b491eb0917a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:35.814707 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-98f73273-b8ce-49ae-84f3-b491eb0917a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:35.815307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-98f73273-b8ce-49ae-84f3-b491eb0917a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:35.815743 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-98f73273-b8ce-49ae-84f3-b491eb0917a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:35.990912 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c7c809e0-866a-410e-a9ea-d413ae8a8c2f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:35.998802 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-98f73273-b8ce-49ae-84f3-b491eb0917a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:36.000637 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c7c809e0-866a-410e-a9ea-d413ae8a8c2f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:36.002465 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c7c809e0-866a-410e-a9ea-d413ae8a8c2f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:36.003660 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c7c809e0-866a-410e-a9ea-d413ae8a8c2f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.258175 Aug 08 14:35:36.004230 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 328/684] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:35 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:35:36.009762 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-98f73273-b8ce-49ae-84f3-b491eb0917a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1661 microversion: 2.1 time: 0.222520 Aug 08 14:35:36.010801 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 357/685] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:35 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1661 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:36.290047 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9cc32f0e-f1d7-4fad-9605-82cabd96738f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:36.290528 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9cc32f0e-f1d7-4fad-9605-82cabd96738f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:36.296435 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9cc32f0e-f1d7-4fad-9605-82cabd96738f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:36.297011 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9cc32f0e-f1d7-4fad-9605-82cabd96738f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:36.297445 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9cc32f0e-f1d7-4fad-9605-82cabd96738f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:36.298122 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9cc32f0e-f1d7-4fad-9605-82cabd96738f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:36.298569 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9cc32f0e-f1d7-4fad-9605-82cabd96738f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:36.298987 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9cc32f0e-f1d7-4fad-9605-82cabd96738f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:36.378783 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-9cc32f0e-f1d7-4fad-9605-82cabd96738f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lazy-loading 'services' on Instance uuid 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:35:36.439516 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-67460ea4-0b3e-4047-aba8-49b8fc398504 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:36.440040 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-67460ea4-0b3e-4047-aba8-49b8fc398504 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:36.446242 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67460ea4-0b3e-4047-aba8-49b8fc398504 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:36.446725 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67460ea4-0b3e-4047-aba8-49b8fc398504 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:36.447187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67460ea4-0b3e-4047-aba8-49b8fc398504 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:36.447892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67460ea4-0b3e-4047-aba8-49b8fc398504 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:36.448349 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67460ea4-0b3e-4047-aba8-49b8fc398504 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:36.448780 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67460ea4-0b3e-4047-aba8-49b8fc398504 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:36.449956 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9cc32f0e-f1d7-4fad-9605-82cabd96738f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments/cb2e329d-3492-4c8d-96df-3172a85c5169" status: 202 len: 0 microversion: 2.1 time: 0.163938 Aug 08 14:35:36.450545 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 329/686] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 14:35:36 2022] DELETE /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments/cb2e329d-3492-4c8d-96df-3172a85c5169 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:35:36.459412 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-60de9f52-8335-4712-8447-295ef299abfa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:36.461709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-60de9f52-8335-4712-8447-295ef299abfa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:36.467980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60de9f52-8335-4712-8447-295ef299abfa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:36.468460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60de9f52-8335-4712-8447-295ef299abfa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:36.468895 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60de9f52-8335-4712-8447-295ef299abfa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:36.469589 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60de9f52-8335-4712-8447-295ef299abfa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:36.470040 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60de9f52-8335-4712-8447-295ef299abfa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:36.470462 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60de9f52-8335-4712-8447-295ef299abfa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:36.476126 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-67460ea4-0b3e-4047-aba8-49b8fc398504 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Going to try to terminate instance {{(pid=118062) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:35:36.500642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-60de9f52-8335-4712-8447-295ef299abfa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045425 Aug 08 14:35:36.501216 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 330/687] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:35:36 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:35:36.553569 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-67460ea4-0b3e-4047-aba8-49b8fc398504 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "DELETE /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 204 len: 0 microversion: 2.1 time: 0.117402 Aug 08 14:35:36.554140 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 358/688] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:35:36 2022] DELETE /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:35:36.562565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-96028a5d-3c93-446b-bae9-69ecdeaf3f19 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:36.563135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-96028a5d-3c93-446b-bae9-69ecdeaf3f19 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:36.569267 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96028a5d-3c93-446b-bae9-69ecdeaf3f19 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:36.569747 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96028a5d-3c93-446b-bae9-69ecdeaf3f19 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:36.570184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96028a5d-3c93-446b-bae9-69ecdeaf3f19 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:36.570876 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96028a5d-3c93-446b-bae9-69ecdeaf3f19 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:36.571377 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96028a5d-3c93-446b-bae9-69ecdeaf3f19 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:36.571801 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96028a5d-3c93-446b-bae9-69ecdeaf3f19 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:36.631742 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-70df8bc7-873a-45e6-9f14-01e8ce48d6e6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:36.632489 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-70df8bc7-873a-45e6-9f14-01e8ce48d6e6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:36.639944 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-70df8bc7-873a-45e6-9f14-01e8ce48d6e6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:36.640399 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-70df8bc7-873a-45e6-9f14-01e8ce48d6e6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:36.641025 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-70df8bc7-873a-45e6-9f14-01e8ce48d6e6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:36.641904 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-70df8bc7-873a-45e6-9f14-01e8ce48d6e6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:36.642361 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-70df8bc7-873a-45e6-9f14-01e8ce48d6e6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:36.642782 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-70df8bc7-873a-45e6-9f14-01e8ce48d6e6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:36.756409 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-96028a5d-3c93-446b-bae9-69ecdeaf3f19 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:36.764418 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-96028a5d-3c93-446b-bae9-69ecdeaf3f19 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1515 microversion: 2.1 time: 0.205782 Aug 08 14:35:36.765003 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 331/689] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:36 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:36.803897 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-70df8bc7-873a-45e6-9f14-01e8ce48d6e6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:36.811668 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-70df8bc7-873a-45e6-9f14-01e8ce48d6e6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.184188 Aug 08 14:35:36.812258 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 359/690] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:36 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:37.027848 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1daadd72-6cac-4596-8596-74cc958e0a50 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:37.028446 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1daadd72-6cac-4596-8596-74cc958e0a50 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:37.031175 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-18d6a382-1169-4f20-99f2-e2f5581d2818 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:37.031784 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-18d6a382-1169-4f20-99f2-e2f5581d2818 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:37.034404 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1daadd72-6cac-4596-8596-74cc958e0a50 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:37.034880 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1daadd72-6cac-4596-8596-74cc958e0a50 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:37.035414 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1daadd72-6cac-4596-8596-74cc958e0a50 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:37.036075 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1daadd72-6cac-4596-8596-74cc958e0a50 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:37.036471 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1daadd72-6cac-4596-8596-74cc958e0a50 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:37.037689 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1daadd72-6cac-4596-8596-74cc958e0a50 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:37.038499 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-18d6a382-1169-4f20-99f2-e2f5581d2818 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:37.038983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-18d6a382-1169-4f20-99f2-e2f5581d2818 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:37.039443 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-18d6a382-1169-4f20-99f2-e2f5581d2818 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:37.040390 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-18d6a382-1169-4f20-99f2-e2f5581d2818 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:37.040844 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-18d6a382-1169-4f20-99f2-e2f5581d2818 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:37.041309 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-18d6a382-1169-4f20-99f2-e2f5581d2818 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:37.232624 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1daadd72-6cac-4596-8596-74cc958e0a50 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:37.236622 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-18d6a382-1169-4f20-99f2-e2f5581d2818 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:37.240662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1daadd72-6cac-4596-8596-74cc958e0a50 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:37.242195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1daadd72-6cac-4596-8596-74cc958e0a50 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:37.243368 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1daadd72-6cac-4596-8596-74cc958e0a50 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.219456 Aug 08 14:35:37.243928 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 332/691] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:37 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:35:37.244800 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-18d6a382-1169-4f20-99f2-e2f5581d2818 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1661 microversion: 2.1 time: 0.217177 Aug 08 14:35:37.244980 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 360/692] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:37 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1661 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:37.513093 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-aeb12619-5897-4889-8552-936c8b36bff0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:37.515369 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-aeb12619-5897-4889-8552-936c8b36bff0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:37.521661 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aeb12619-5897-4889-8552-936c8b36bff0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:37.522137 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aeb12619-5897-4889-8552-936c8b36bff0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:37.522570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aeb12619-5897-4889-8552-936c8b36bff0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:37.523284 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aeb12619-5897-4889-8552-936c8b36bff0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:37.523738 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aeb12619-5897-4889-8552-936c8b36bff0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:37.524162 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aeb12619-5897-4889-8552-936c8b36bff0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:37.554152 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-aeb12619-5897-4889-8552-936c8b36bff0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045005 Aug 08 14:35:37.554704 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 333/693] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:35:37 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:37.786325 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-fe7919b9-756e-4f3d-a467-f02ec33e55c0 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:37.786890 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-fe7919b9-756e-4f3d-a467-f02ec33e55c0 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:37.793714 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fe7919b9-756e-4f3d-a467-f02ec33e55c0 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:37.794198 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fe7919b9-756e-4f3d-a467-f02ec33e55c0 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:37.794630 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fe7919b9-756e-4f3d-a467-f02ec33e55c0 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:37.795359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fe7919b9-756e-4f3d-a467-f02ec33e55c0 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:37.795817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fe7919b9-756e-4f3d-a467-f02ec33e55c0 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:37.796248 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fe7919b9-756e-4f3d-a467-f02ec33e55c0 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:37.832419 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-eba84dc7-370f-4e4c-b139-b8a5a3c5bcf5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:37.833036 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-eba84dc7-370f-4e4c-b139-b8a5a3c5bcf5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:37.838940 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba84dc7-370f-4e4c-b139-b8a5a3c5bcf5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:37.839464 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba84dc7-370f-4e4c-b139-b8a5a3c5bcf5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:37.839901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba84dc7-370f-4e4c-b139-b8a5a3c5bcf5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:37.840604 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba84dc7-370f-4e4c-b139-b8a5a3c5bcf5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:37.841047 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba84dc7-370f-4e4c-b139-b8a5a3c5bcf5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:37.841473 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba84dc7-370f-4e4c-b139-b8a5a3c5bcf5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:37.983641 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-fe7919b9-756e-4f3d-a467-f02ec33e55c0 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:37.992014 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-fe7919b9-756e-4f3d-a467-f02ec33e55c0 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1515 microversion: 2.1 time: 0.209671 Aug 08 14:35:37.992603 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 361/694] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:37 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:38.008359 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-eba84dc7-370f-4e4c-b139-b8a5a3c5bcf5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:38.015936 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-eba84dc7-370f-4e4c-b139-b8a5a3c5bcf5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.187253 Aug 08 14:35:38.016507 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 334/695] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:37 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:38.265449 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ecb470d4-5845-4224-ae4d-68ebe7d99b9b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:38.266060 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ecb470d4-5845-4224-ae4d-68ebe7d99b9b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:38.266844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-67e7828d-74f3-4701-9474-8c2d75e2bdc7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:38.267497 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-67e7828d-74f3-4701-9474-8c2d75e2bdc7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:38.273647 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ecb470d4-5845-4224-ae4d-68ebe7d99b9b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:38.274214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ecb470d4-5845-4224-ae4d-68ebe7d99b9b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:38.274660 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ecb470d4-5845-4224-ae4d-68ebe7d99b9b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:38.275410 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ecb470d4-5845-4224-ae4d-68ebe7d99b9b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:38.275642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-67e7828d-74f3-4701-9474-8c2d75e2bdc7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:38.275911 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ecb470d4-5845-4224-ae4d-68ebe7d99b9b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:38.276143 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-67e7828d-74f3-4701-9474-8c2d75e2bdc7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:38.276339 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ecb470d4-5845-4224-ae4d-68ebe7d99b9b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:38.276587 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-67e7828d-74f3-4701-9474-8c2d75e2bdc7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:38.277338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-67e7828d-74f3-4701-9474-8c2d75e2bdc7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:38.277831 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-67e7828d-74f3-4701-9474-8c2d75e2bdc7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:38.278253 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-67e7828d-74f3-4701-9474-8c2d75e2bdc7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:38.478118 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ecb470d4-5845-4224-ae4d-68ebe7d99b9b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:38.485782 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-67e7828d-74f3-4701-9474-8c2d75e2bdc7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:38.486324 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ecb470d4-5845-4224-ae4d-68ebe7d99b9b tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1661 microversion: 2.1 time: 0.224605 Aug 08 14:35:38.486921 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 362/696] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:38 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1661 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:38.494287 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-67e7828d-74f3-4701-9474-8c2d75e2bdc7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:38.495894 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-67e7828d-74f3-4701-9474-8c2d75e2bdc7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:38.497117 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-67e7828d-74f3-4701-9474-8c2d75e2bdc7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.234099 Aug 08 14:35:38.497684 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 335/697] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:38 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:35:38.566787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-843deeee-4531-4603-bed4-0457b4f5a751 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:38.569020 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-843deeee-4531-4603-bed4-0457b4f5a751 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:38.575153 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-843deeee-4531-4603-bed4-0457b4f5a751 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:38.575644 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-843deeee-4531-4603-bed4-0457b4f5a751 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:38.576080 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-843deeee-4531-4603-bed4-0457b4f5a751 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:38.576781 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-843deeee-4531-4603-bed4-0457b4f5a751 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:38.577240 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-843deeee-4531-4603-bed4-0457b4f5a751 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:38.577662 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-843deeee-4531-4603-bed4-0457b4f5a751 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:38.608251 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-843deeee-4531-4603-bed4-0457b4f5a751 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045960 Aug 08 14:35:38.608808 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 363/698] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:35:38 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:39.013367 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-23814e4b-b56a-414b-8795-67e6dff3600e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:39.014001 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-23814e4b-b56a-414b-8795-67e6dff3600e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:39.020416 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23814e4b-b56a-414b-8795-67e6dff3600e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:39.020929 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23814e4b-b56a-414b-8795-67e6dff3600e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:39.021362 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23814e4b-b56a-414b-8795-67e6dff3600e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:39.022058 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23814e4b-b56a-414b-8795-67e6dff3600e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:39.022501 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23814e4b-b56a-414b-8795-67e6dff3600e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:39.022915 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23814e4b-b56a-414b-8795-67e6dff3600e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:39.036863 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-29d94a5b-6b6d-43cb-aa5a-261663e6abcf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:39.037591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-29d94a5b-6b6d-43cb-aa5a-261663e6abcf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:39.044456 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29d94a5b-6b6d-43cb-aa5a-261663e6abcf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:39.044942 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29d94a5b-6b6d-43cb-aa5a-261663e6abcf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:39.045378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29d94a5b-6b6d-43cb-aa5a-261663e6abcf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:39.046075 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29d94a5b-6b6d-43cb-aa5a-261663e6abcf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:39.046531 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29d94a5b-6b6d-43cb-aa5a-261663e6abcf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:39.046951 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-29d94a5b-6b6d-43cb-aa5a-261663e6abcf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:39.234496 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-23814e4b-b56a-414b-8795-67e6dff3600e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:39.238361 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-29d94a5b-6b6d-43cb-aa5a-261663e6abcf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:39.243870 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-23814e4b-b56a-414b-8795-67e6dff3600e tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1515 microversion: 2.1 time: 0.234356 Aug 08 14:35:39.244789 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 336/699] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:39 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:39.246836 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-29d94a5b-6b6d-43cb-aa5a-261663e6abcf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.214318 Aug 08 14:35:39.257670 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 364/700] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:39 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:39.507662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d0f5c73a-3a11-420c-b406-90d2c065d133 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:39.508182 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d0f5c73a-3a11-420c-b406-90d2c065d133 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:39.514179 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d0f5c73a-3a11-420c-b406-90d2c065d133 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:39.514664 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d0f5c73a-3a11-420c-b406-90d2c065d133 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:39.515137 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d0f5c73a-3a11-420c-b406-90d2c065d133 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:39.515823 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d0f5c73a-3a11-420c-b406-90d2c065d133 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:39.516284 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d0f5c73a-3a11-420c-b406-90d2c065d133 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:39.516709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d0f5c73a-3a11-420c-b406-90d2c065d133 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:39.519897 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-01d1f570-aee5-47e9-8685-e3aae8d951a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:39.520561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-01d1f570-aee5-47e9-8685-e3aae8d951a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:39.526191 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-01d1f570-aee5-47e9-8685-e3aae8d951a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:39.526672 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-01d1f570-aee5-47e9-8685-e3aae8d951a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:39.527114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-01d1f570-aee5-47e9-8685-e3aae8d951a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:39.527817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-01d1f570-aee5-47e9-8685-e3aae8d951a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:39.528268 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-01d1f570-aee5-47e9-8685-e3aae8d951a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:39.528781 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-01d1f570-aee5-47e9-8685-e3aae8d951a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:39.720052 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d0f5c73a-3a11-420c-b406-90d2c065d133 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:39.727505 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-01d1f570-aee5-47e9-8685-e3aae8d951a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:39.735269 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d0f5c73a-3a11-420c-b406-90d2c065d133 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1661 microversion: 2.1 time: 0.231443 Aug 08 14:35:39.736125 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 337/701] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:39 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1661 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:39.736488 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-01d1f570-aee5-47e9-8685-e3aae8d951a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:39.739114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-01d1f570-aee5-47e9-8685-e3aae8d951a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:39.741001 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-01d1f570-aee5-47e9-8685-e3aae8d951a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.224763 Aug 08 14:35:39.741468 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1368fc9c-3100-40a5-8ad9-ccf18f419a89 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:39.744032 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1368fc9c-3100-40a5-8ad9-ccf18f419a89 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:39.750619 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1368fc9c-3100-40a5-8ad9-ccf18f419a89 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:39.751227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1368fc9c-3100-40a5-8ad9-ccf18f419a89 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:39.751756 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1368fc9c-3100-40a5-8ad9-ccf18f419a89 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:39.752569 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1368fc9c-3100-40a5-8ad9-ccf18f419a89 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:39.753054 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1368fc9c-3100-40a5-8ad9-ccf18f419a89 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:39.753554 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1368fc9c-3100-40a5-8ad9-ccf18f419a89 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:39.756390 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 365/702] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:39 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:35:39.787371 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1368fc9c-3100-40a5-8ad9-ccf18f419a89 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049482 Aug 08 14:35:39.787861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 338/703] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:35:39 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:39.939578 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-398d5ecf-0cf4-4ed1-a7f5-4a2c1bc55d79 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:39.940067 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-398d5ecf-0cf4-4ed1-a7f5-4a2c1bc55d79 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:39.945974 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-398d5ecf-0cf4-4ed1-a7f5-4a2c1bc55d79 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:39.946450 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-398d5ecf-0cf4-4ed1-a7f5-4a2c1bc55d79 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:39.946877 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-398d5ecf-0cf4-4ed1-a7f5-4a2c1bc55d79 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:39.947590 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-398d5ecf-0cf4-4ed1-a7f5-4a2c1bc55d79 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:39.948038 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-398d5ecf-0cf4-4ed1-a7f5-4a2c1bc55d79 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:39.948456 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-398d5ecf-0cf4-4ed1-a7f5-4a2c1bc55d79 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:39.973550 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-398d5ecf-0cf4-4ed1-a7f5-4a2c1bc55d79 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Going to try to terminate instance {{(pid=118062) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:35:40.006729 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:40.069874 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-398d5ecf-0cf4-4ed1-a7f5-4a2c1bc55d79 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 204 len: 0 microversion: 2.1 time: 0.133728 Aug 08 14:35:40.071351 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 366/704] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:35:39 2022] DELETE /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 14:35:40.079385 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-71152684-9053-4b8c-ad4f-643a0d9a6658 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:40.080536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-71152684-9053-4b8c-ad4f-643a0d9a6658 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:40.088346 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-71152684-9053-4b8c-ad4f-643a0d9a6658 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:40.088970 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-71152684-9053-4b8c-ad4f-643a0d9a6658 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:40.089493 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-71152684-9053-4b8c-ad4f-643a0d9a6658 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:40.090483 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-71152684-9053-4b8c-ad4f-643a0d9a6658 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:40.090952 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-71152684-9053-4b8c-ad4f-643a0d9a6658 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:40.091402 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-71152684-9053-4b8c-ad4f-643a0d9a6658 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:40.222638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-71152684-9053-4b8c-ad4f-643a0d9a6658 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:40.230217 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-71152684-9053-4b8c-ad4f-643a0d9a6658 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1576 microversion: 2.1 time: 0.154808 Aug 08 14:35:40.230788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 339/705] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:40 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:40.266236 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c9789ace-570b-4c18-820c-83018cd35f42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:40.266920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c9789ace-570b-4c18-820c-83018cd35f42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:40.268353 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8eb6fb1f-1452-4011-8d1e-5b58e098eb36 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:40.268960 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8eb6fb1f-1452-4011-8d1e-5b58e098eb36 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:40.273551 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9789ace-570b-4c18-820c-83018cd35f42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:40.274058 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9789ace-570b-4c18-820c-83018cd35f42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:40.274556 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9789ace-570b-4c18-820c-83018cd35f42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:40.275234 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9789ace-570b-4c18-820c-83018cd35f42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:40.275682 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9789ace-570b-4c18-820c-83018cd35f42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:40.275781 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8eb6fb1f-1452-4011-8d1e-5b58e098eb36 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:40.276100 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9789ace-570b-4c18-820c-83018cd35f42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:40.276196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8eb6fb1f-1452-4011-8d1e-5b58e098eb36 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:40.277449 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8eb6fb1f-1452-4011-8d1e-5b58e098eb36 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:40.278212 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8eb6fb1f-1452-4011-8d1e-5b58e098eb36 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:40.278833 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8eb6fb1f-1452-4011-8d1e-5b58e098eb36 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:40.279302 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8eb6fb1f-1452-4011-8d1e-5b58e098eb36 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:40.471204 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8eb6fb1f-1452-4011-8d1e-5b58e098eb36 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:40.473659 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:40.478559 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c9789ace-570b-4c18-820c-83018cd35f42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:40.481888 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8eb6fb1f-1452-4011-8d1e-5b58e098eb36 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.217082 Aug 08 14:35:40.482700 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 340/706] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:40 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:40.489261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c9789ace-570b-4c18-820c-83018cd35f42 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1515 microversion: 2.1 time: 0.227164 Aug 08 14:35:40.490413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 367/707] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:40 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1515 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:40.658216 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f5d1d92b-859f-4ccd-97e8-62a5fe3d911a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37786a21-790d-4654-8097-4b348551cb66"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:40.660618 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f5d1d92b-859f-4ccd-97e8-62a5fe3d911a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:40.668131 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5d1d92b-859f-4ccd-97e8-62a5fe3d911a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:40.668630 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5d1d92b-859f-4ccd-97e8-62a5fe3d911a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:40.669137 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5d1d92b-859f-4ccd-97e8-62a5fe3d911a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:40.669792 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5d1d92b-859f-4ccd-97e8-62a5fe3d911a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:40.670249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5d1d92b-859f-4ccd-97e8-62a5fe3d911a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:40.670682 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5d1d92b-859f-4ccd-97e8-62a5fe3d911a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:40.757563 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-20592edd-81e4-44b0-bc8e-3f62a1268054 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:40.760098 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-20592edd-81e4-44b0-bc8e-3f62a1268054 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:40.766097 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-20592edd-81e4-44b0-bc8e-3f62a1268054 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:40.766594 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-20592edd-81e4-44b0-bc8e-3f62a1268054 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:40.767109 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-20592edd-81e4-44b0-bc8e-3f62a1268054 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:40.767872 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-20592edd-81e4-44b0-bc8e-3f62a1268054 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:40.768449 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-20592edd-81e4-44b0-bc8e-3f62a1268054 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:40.768961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-20592edd-81e4-44b0-bc8e-3f62a1268054 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:41.010003 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-20592edd-81e4-44b0-bc8e-3f62a1268054 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:41.017367 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-20592edd-81e4-44b0-bc8e-3f62a1268054 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1661 microversion: 2.1 time: 0.264221 Aug 08 14:35:41.017933 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 368/708] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:40 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1661 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:41.030851 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-47cfe93b-f031-415a-8dc3-ce251cda4bd3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:41.030851 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-47cfe93b-f031-415a-8dc3-ce251cda4bd3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:41.030851 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47cfe93b-f031-415a-8dc3-ce251cda4bd3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:41.030851 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47cfe93b-f031-415a-8dc3-ce251cda4bd3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:41.031253 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47cfe93b-f031-415a-8dc3-ce251cda4bd3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:41.031253 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47cfe93b-f031-415a-8dc3-ce251cda4bd3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:41.031253 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47cfe93b-f031-415a-8dc3-ce251cda4bd3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:41.031253 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-47cfe93b-f031-415a-8dc3-ce251cda4bd3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:41.249725 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-47cfe93b-f031-415a-8dc3-ce251cda4bd3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:41.263129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-47cfe93b-f031-415a-8dc3-ce251cda4bd3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:41.264684 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-47cfe93b-f031-415a-8dc3-ce251cda4bd3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:41.266040 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-47cfe93b-f031-415a-8dc3-ce251cda4bd3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1720 microversion: 2.20 time: 0.246982 Aug 08 14:35:41.266601 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 369/709] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:41 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1720 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:35:41.271946 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-652efb87-2191-4050-b964-ef34ca35878b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:41.274224 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-652efb87-2191-4050-b964-ef34ca35878b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:41.282364 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-652efb87-2191-4050-b964-ef34ca35878b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:41.282854 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-652efb87-2191-4050-b964-ef34ca35878b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:41.283427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-652efb87-2191-4050-b964-ef34ca35878b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:41.284305 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-652efb87-2191-4050-b964-ef34ca35878b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:41.284488 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-652efb87-2191-4050-b964-ef34ca35878b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:41.284892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-652efb87-2191-4050-b964-ef34ca35878b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:41.322460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-652efb87-2191-4050-b964-ef34ca35878b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054791 Aug 08 14:35:41.323036 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 370/710] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:35:41 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:41.329163 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-2b8e9282-c35f-414e-976e-f1bb4161ee01 req-44cf384c-1919-4f1c-9eeb-93e90c161fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7117df5-9606-4392-a933-e624f6e97e2e", "name": "network-vif-plugged", "status": "completed", "tag": "d8539c0a-5ff5-4ee6-883f-9961bff24df3"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:41.342428 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-2b8e9282-c35f-414e-976e-f1bb4161ee01 req-44cf384c-1919-4f1c-9eeb-93e90c161fb7 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:41.342910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-2b8e9282-c35f-414e-976e-f1bb4161ee01 req-44cf384c-1919-4f1c-9eeb-93e90c161fb7 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:41.343510 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-2b8e9282-c35f-414e-976e-f1bb4161ee01 req-44cf384c-1919-4f1c-9eeb-93e90c161fb7 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:41.356045 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-2b8e9282-c35f-414e-976e-f1bb4161ee01 req-44cf384c-1919-4f1c-9eeb-93e90c161fb7 service nova] Creating event network-vif-plugged:d8539c0a-5ff5-4ee6-883f-9961bff24df3 for instance a7117df5-9606-4392-a933-e624f6e97e2e on hv-cinder-85200 Aug 08 14:35:41.361036 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-2b8e9282-c35f-414e-976e-f1bb4161ee01 req-44cf384c-1919-4f1c-9eeb-93e90c161fb7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036394 Aug 08 14:35:41.361642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 371/711] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:41.366769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b15ab21c-e2a0-4ff7-9c3a-56df27335222 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:41.367490 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b15ab21c-e2a0-4ff7-9c3a-56df27335222 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:41.373600 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b15ab21c-e2a0-4ff7-9c3a-56df27335222 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:41.374085 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b15ab21c-e2a0-4ff7-9c3a-56df27335222 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:41.374525 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b15ab21c-e2a0-4ff7-9c3a-56df27335222 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:41.375283 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b15ab21c-e2a0-4ff7-9c3a-56df27335222 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:41.375744 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b15ab21c-e2a0-4ff7-9c3a-56df27335222 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:41.376171 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b15ab21c-e2a0-4ff7-9c3a-56df27335222 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:41.604888 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b15ab21c-e2a0-4ff7-9c3a-56df27335222 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:41.615193 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b15ab21c-e2a0-4ff7-9c3a-56df27335222 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1576 microversion: 2.1 time: 0.251503 Aug 08 14:35:41.616091 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 372/712] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:41 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:41.627669 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ba47986f-d8db-4e1b-b23e-737862ec5b23 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:41.628839 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ba47986f-d8db-4e1b-b23e-737862ec5b23 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:41.635625 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba47986f-d8db-4e1b-b23e-737862ec5b23 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:41.636362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba47986f-d8db-4e1b-b23e-737862ec5b23 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:41.636955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba47986f-d8db-4e1b-b23e-737862ec5b23 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:41.637675 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba47986f-d8db-4e1b-b23e-737862ec5b23 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:41.638672 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba47986f-d8db-4e1b-b23e-737862ec5b23 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:41.639190 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ba47986f-d8db-4e1b-b23e-737862ec5b23 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:42.101612 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ba47986f-d8db-4e1b-b23e-737862ec5b23 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:42.111180 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ba47986f-d8db-4e1b-b23e-737862ec5b23 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.493268 Aug 08 14:35:42.112131 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 373/713] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:41 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:42.119566 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-876c6285-dbe9-481a-a664-2a735470687d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:42.120702 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-876c6285-dbe9-481a-a664-2a735470687d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:42.127078 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-876c6285-dbe9-481a-a664-2a735470687d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:42.128326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-876c6285-dbe9-481a-a664-2a735470687d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:42.128912 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-876c6285-dbe9-481a-a664-2a735470687d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:42.129856 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-876c6285-dbe9-481a-a664-2a735470687d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:42.131009 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-876c6285-dbe9-481a-a664-2a735470687d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:42.131548 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-876c6285-dbe9-481a-a664-2a735470687d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:42.141056 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f5d1d92b-859f-4ccd-97e8-62a5fe3d911a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "POST /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.486860 Aug 08 14:35:42.147617 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 341/714] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 14:35:40 2022] POST /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments => generated 194 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:42.150584 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-024bc755-ef9b-4f06-8975-6a77e10e064d req-20dff4c0-d922-407d-900b-23909d91b693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0245e7-b0d0-4fbe-a233-4b3e7768b94c", "name": "network-vif-deleted", "tag": "87f964c5-59f7-49fd-885c-ebcb610ccd3e"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:42.161129 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-024bc755-ef9b-4f06-8975-6a77e10e064d req-20dff4c0-d922-407d-900b-23909d91b693 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:42.161881 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-024bc755-ef9b-4f06-8975-6a77e10e064d req-20dff4c0-d922-407d-900b-23909d91b693 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:42.162470 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-024bc755-ef9b-4f06-8975-6a77e10e064d req-20dff4c0-d922-407d-900b-23909d91b693 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:42.180983 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-024bc755-ef9b-4f06-8975-6a77e10e064d req-20dff4c0-d922-407d-900b-23909d91b693 service nova] Creating event network-vif-deleted:87f964c5-59f7-49fd-885c-ebcb610ccd3e for instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c on hv-cinder-85200 Aug 08 14:35:42.188349 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-024bc755-ef9b-4f06-8975-6a77e10e064d req-20dff4c0-d922-407d-900b-23909d91b693 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044244 Aug 08 14:35:42.189908 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 342/715] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:42.196181 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2a0027a6-e16f-45b3-bf57-f75245632184 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:42.197296 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2a0027a6-e16f-45b3-bf57-f75245632184 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:42.200633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=100 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:42.207076 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a0027a6-e16f-45b3-bf57-f75245632184 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:42.207803 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a0027a6-e16f-45b3-bf57-f75245632184 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:42.208434 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a0027a6-e16f-45b3-bf57-f75245632184 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:42.209767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a0027a6-e16f-45b3-bf57-f75245632184 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:42.210408 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a0027a6-e16f-45b3-bf57-f75245632184 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:42.211206 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a0027a6-e16f-45b3-bf57-f75245632184 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:42.508417 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-876c6285-dbe9-481a-a664-2a735470687d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:42.519023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-876c6285-dbe9-481a-a664-2a735470687d tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1515 microversion: 2.1 time: 0.405591 Aug 08 14:35:42.519653 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 374/716] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:42 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1515 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:42.524714 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:42.525402 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:42.531668 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:42.532505 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:42.533014 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:42.533805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:42.534342 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:42.534859 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:42.566995 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2a0027a6-e16f-45b3-bf57-f75245632184 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:42.573106 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:42.573830 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:42.574495 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:42.575136 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lazy-loading 'fault' on Instance uuid fd0245e7-b0d0-4fbe-a233-4b3e7768b94c {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:35:42.577833 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2a0027a6-e16f-45b3-bf57-f75245632184 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1661 microversion: 2.1 time: 0.386565 Aug 08 14:35:42.587123 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 343/717] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:42 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1661 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:42.587123 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f61e5d54-6add-4ea9-8a4c-db1123befefb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:42.587123 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f61e5d54-6add-4ea9-8a4c-db1123befefb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:42.599593 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f61e5d54-6add-4ea9-8a4c-db1123befefb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:42.600008 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f61e5d54-6add-4ea9-8a4c-db1123befefb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:42.600449 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f61e5d54-6add-4ea9-8a4c-db1123befefb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:42.601163 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f61e5d54-6add-4ea9-8a4c-db1123befefb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:42.601620 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f61e5d54-6add-4ea9-8a4c-db1123befefb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:42.602046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f61e5d54-6add-4ea9-8a4c-db1123befefb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:42.641149 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f61e5d54-6add-4ea9-8a4c-db1123befefb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060399 Aug 08 14:35:42.642021 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 344/718] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:35:42 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:42.647434 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bb2063d2-99c3-41c9-8868-a655816936b6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:42.648339 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bb2063d2-99c3-41c9-8868-a655816936b6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:42.650990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:42.654464 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bb2063d2-99c3-41c9-8868-a655816936b6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:42.654952 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bb2063d2-99c3-41c9-8868-a655816936b6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:42.655412 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bb2063d2-99c3-41c9-8868-a655816936b6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:42.656113 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bb2063d2-99c3-41c9-8868-a655816936b6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:42.656562 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bb2063d2-99c3-41c9-8868-a655816936b6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:42.656999 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bb2063d2-99c3-41c9-8868-a655816936b6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:42.668905 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:42.670458 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:42.671663 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8722f9c0-ba10-48e2-a215-5cb413691079 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 200 len: 1369 microversion: 2.20 time: 0.150875 Aug 08 14:35:42.677874 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 375/719] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:42 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:35:42.884348 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bb2063d2-99c3-41c9-8868-a655816936b6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:42.893401 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bb2063d2-99c3-41c9-8868-a655816936b6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1576 microversion: 2.1 time: 0.250075 Aug 08 14:35:42.894340 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 345/720] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:42 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1576 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:43.132457 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-392bd374-8ea6-46c8-8beb-df253ea5ab4c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:43.133730 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-392bd374-8ea6-46c8-8beb-df253ea5ab4c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:43.140712 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-392bd374-8ea6-46c8-8beb-df253ea5ab4c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.142178 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-392bd374-8ea6-46c8-8beb-df253ea5ab4c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.142929 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-392bd374-8ea6-46c8-8beb-df253ea5ab4c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:43.144049 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-392bd374-8ea6-46c8-8beb-df253ea5ab4c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.144727 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-392bd374-8ea6-46c8-8beb-df253ea5ab4c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.145434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-392bd374-8ea6-46c8-8beb-df253ea5ab4c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:43.338735 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-392bd374-8ea6-46c8-8beb-df253ea5ab4c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:43.346452 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-392bd374-8ea6-46c8-8beb-df253ea5ab4c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.218632 Aug 08 14:35:43.346981 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 376/721] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:43 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:43.540333 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6cdd11bb-25a9-4011-8dc7-e625fb5496ce tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:43.541100 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6cdd11bb-25a9-4011-8dc7-e625fb5496ce tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:43.547964 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6cdd11bb-25a9-4011-8dc7-e625fb5496ce tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.548546 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6cdd11bb-25a9-4011-8dc7-e625fb5496ce tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.549251 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6cdd11bb-25a9-4011-8dc7-e625fb5496ce tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:43.549994 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6cdd11bb-25a9-4011-8dc7-e625fb5496ce tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.550620 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6cdd11bb-25a9-4011-8dc7-e625fb5496ce tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.551049 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6cdd11bb-25a9-4011-8dc7-e625fb5496ce tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:43.587813 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6cdd11bb-25a9-4011-8dc7-e625fb5496ce tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.588298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6cdd11bb-25a9-4011-8dc7-e625fb5496ce tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.588792 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6cdd11bb-25a9-4011-8dc7-e625fb5496ce tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:43.589221 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-6cdd11bb-25a9-4011-8dc7-e625fb5496ce tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lazy-loading 'fault' on Instance uuid 61b75b2c-76ff-4530-9553-9fb04db7c082 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:35:43.600414 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b47067a7-06e8-4ad9-b9ea-6cb3daedfba3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:43.601647 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b47067a7-06e8-4ad9-b9ea-6cb3daedfba3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:43.608418 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b47067a7-06e8-4ad9-b9ea-6cb3daedfba3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.609192 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b47067a7-06e8-4ad9-b9ea-6cb3daedfba3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.609680 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b47067a7-06e8-4ad9-b9ea-6cb3daedfba3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:43.610422 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b47067a7-06e8-4ad9-b9ea-6cb3daedfba3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.611242 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b47067a7-06e8-4ad9-b9ea-6cb3daedfba3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.611871 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b47067a7-06e8-4ad9-b9ea-6cb3daedfba3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:43.648338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6cdd11bb-25a9-4011-8dc7-e625fb5496ce tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:43.655083 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6cdd11bb-25a9-4011-8dc7-e625fb5496ce tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1309 microversion: 2.1 time: 0.119039 Aug 08 14:35:43.655695 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 346/722] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:43 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:43.660616 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6598e07b-341a-43a5-9b9c-b13ff0216833 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:43.663113 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6598e07b-341a-43a5-9b9c-b13ff0216833 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:43.672245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6598e07b-341a-43a5-9b9c-b13ff0216833 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.672737 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6598e07b-341a-43a5-9b9c-b13ff0216833 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.673177 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6598e07b-341a-43a5-9b9c-b13ff0216833 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:43.673925 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6598e07b-341a-43a5-9b9c-b13ff0216833 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.674378 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6598e07b-341a-43a5-9b9c-b13ff0216833 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.674802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6598e07b-341a-43a5-9b9c-b13ff0216833 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:43.706403 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6598e07b-341a-43a5-9b9c-b13ff0216833 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049460 Aug 08 14:35:43.712591 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 347/723] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:35:43 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 14:35:43.712591 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-392fa607-8800-444b-8abd-7d0c43aac6d1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:43.712591 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-392fa607-8800-444b-8abd-7d0c43aac6d1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:43.718148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-392fa607-8800-444b-8abd-7d0c43aac6d1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.718637 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-392fa607-8800-444b-8abd-7d0c43aac6d1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.719073 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-392fa607-8800-444b-8abd-7d0c43aac6d1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:43.719791 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-392fa607-8800-444b-8abd-7d0c43aac6d1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.720243 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-392fa607-8800-444b-8abd-7d0c43aac6d1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.720662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-392fa607-8800-444b-8abd-7d0c43aac6d1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:43.737539 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-392fa607-8800-444b-8abd-7d0c43aac6d1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] HTTP exception thrown: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-392fa607-8800-444b-8abd-7d0c43aac6d1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Request method failure captured: Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c HTTP/1.1 Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4eFRQxVL1NY3_tx_qiqxwLmZrSvOeRyO8y9Q4-ETjuT7myDyeuwE3LKjiXygw__BMoz7NpPBYCZhi6Sbk7IzqYL1uEBrHZpteZsX4u-VuWdTzcEZMq581XIJ38xWOfnxo0KPoNJtai0-08vQPq9qLGHpD9ujQHSnZ4RX2KelrCBkk Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: fa2ecaeb6faf4c1ea5eac70b19398b42 Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:35:43.740323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:35:43.741763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fa2ecaeb6faf4c1ea5eac70b19398b42", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}] Aug 08 14:35:43.741763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:35:43.741763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: fa2ecaeb6faf4c1ea5eac70b19398b42 Aug 08 14:35:43.741763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:35:43.741763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeShelveTestJSON-290340830-project Aug 08 14:35:43.741763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:35:43.741763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:35:43.741763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 84d2f3c3c5fb4cceabf9a35f64a1551c Aug 08 14:35:43.741763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeShelveTestJSON-290340830-project Aug 08 14:35:43.741763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:35:43.741763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:35:43.741763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'fd0245e7-b0d0-4fbe-a233-4b3e7768b94c'} Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:35:43.742459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:35:43.743612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:35:43.744676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-392fa607-8800-444b-8abd-7d0c43aac6d1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Returning 404 to user: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:35:43.744676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-392fa607-8800-444b-8abd-7d0c43aac6d1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 404 len: 111 microversion: 2.20 time: 0.033708 Aug 08 14:35:43.744676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 348/724] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:43 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 14:35:43.752568 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fadc27f3-d4ed-4156-a47f-970c0b15c301 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '.version_select at 0x7f9cb24ab550>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:43.779643 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fadc27f3-d4ed-4156-a47f-970c0b15c301 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-564161905" status: 204 len: 0 microversion: 2.20 time: 0.031191 Aug 08 14:35:43.780813 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 349/725] 10.222.0.50 () {60 vars in 1259 bytes} [Mon Aug 8 14:35:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-564161905 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 14:35:43.786262 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-101906f6-6f36-4d9f-8b4c-e5405d24c60d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:43.786849 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-101906f6-6f36-4d9f-8b4c-e5405d24c60d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:43.796545 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-101906f6-6f36-4d9f-8b4c-e5405d24c60d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.797457 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-101906f6-6f36-4d9f-8b4c-e5405d24c60d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.798258 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-101906f6-6f36-4d9f-8b4c-e5405d24c60d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:43.799654 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-101906f6-6f36-4d9f-8b4c-e5405d24c60d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.800744 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-101906f6-6f36-4d9f-8b4c-e5405d24c60d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.801578 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-101906f6-6f36-4d9f-8b4c-e5405d24c60d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:43.850066 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b47067a7-06e8-4ad9-b9ea-6cb3daedfba3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:43.850644 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-101906f6-6f36-4d9f-8b4c-e5405d24c60d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:35:43.862358 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b47067a7-06e8-4ad9-b9ea-6cb3daedfba3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1665 microversion: 2.1 time: 0.265711 Aug 08 14:35:43.863211 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 377/726] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:43 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1665 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:43.921197 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f131c1c3-d683-4075-9c31-9548f5535f00 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:43.922162 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f131c1c3-d683-4075-9c31-9548f5535f00 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:43.933535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f131c1c3-d683-4075-9c31-9548f5535f00 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.934423 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f131c1c3-d683-4075-9c31-9548f5535f00 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.935251 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f131c1c3-d683-4075-9c31-9548f5535f00 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:43.936176 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f131c1c3-d683-4075-9c31-9548f5535f00 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:43.936863 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f131c1c3-d683-4075-9c31-9548f5535f00 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:43.937473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f131c1c3-d683-4075-9c31-9548f5535f00 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:44.028228 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-101906f6-6f36-4d9f-8b4c-e5405d24c60d tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 204 len: 0 microversion: 2.1 time: 0.245572 Aug 08 14:35:44.031136 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 350/727] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:35:43 2022] DELETE /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:35:44.045155 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c4bf0bec-a576-405b-b42b-e1b39e25d255 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:44.045935 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c4bf0bec-a576-405b-b42b-e1b39e25d255 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:44.052805 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c4bf0bec-a576-405b-b42b-e1b39e25d255 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:44.053771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c4bf0bec-a576-405b-b42b-e1b39e25d255 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:44.053771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c4bf0bec-a576-405b-b42b-e1b39e25d255 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:44.054417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c4bf0bec-a576-405b-b42b-e1b39e25d255 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:44.055062 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c4bf0bec-a576-405b-b42b-e1b39e25d255 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:44.055665 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c4bf0bec-a576-405b-b42b-e1b39e25d255 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:44.236167 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f131c1c3-d683-4075-9c31-9548f5535f00 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:44.245162 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f131c1c3-d683-4075-9c31-9548f5535f00 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1576 microversion: 2.1 time: 0.330323 Aug 08 14:35:44.248686 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 378/728] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:43 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1576 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:44.255339 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-e8437df9-5aef-48a1-a55b-4ad5374bb84d req-8346f9ba-d043-4ee1-b61c-bcf2d65a8732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b75b2c-76ff-4530-9553-9fb04db7c082", "name": "network-vif-deleted", "tag": "d9f0a1fb-b83d-4e01-9a8d-1388224f3e9c"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:44.267841 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-e8437df9-5aef-48a1-a55b-4ad5374bb84d req-8346f9ba-d043-4ee1-b61c-bcf2d65a8732 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:44.268331 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-e8437df9-5aef-48a1-a55b-4ad5374bb84d req-8346f9ba-d043-4ee1-b61c-bcf2d65a8732 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:44.268825 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-e8437df9-5aef-48a1-a55b-4ad5374bb84d req-8346f9ba-d043-4ee1-b61c-bcf2d65a8732 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:44.300188 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-e8437df9-5aef-48a1-a55b-4ad5374bb84d req-8346f9ba-d043-4ee1-b61c-bcf2d65a8732 service nova] Creating event network-vif-deleted:d9f0a1fb-b83d-4e01-9a8d-1388224f3e9c for instance 61b75b2c-76ff-4530-9553-9fb04db7c082 on hv-cinder-85200 Aug 08 14:35:44.307427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-e8437df9-5aef-48a1-a55b-4ad5374bb84d req-8346f9ba-d043-4ee1-b61c-bcf2d65a8732 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057102 Aug 08 14:35:44.309210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 379/729] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:44.367513 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f3e8b1f2-b7c3-4c24-bb70-3e9fe6759265 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:44.368580 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f3e8b1f2-b7c3-4c24-bb70-3e9fe6759265 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:44.375159 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f3e8b1f2-b7c3-4c24-bb70-3e9fe6759265 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:44.375907 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f3e8b1f2-b7c3-4c24-bb70-3e9fe6759265 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:44.376866 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f3e8b1f2-b7c3-4c24-bb70-3e9fe6759265 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:44.378034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f3e8b1f2-b7c3-4c24-bb70-3e9fe6759265 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:44.378566 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f3e8b1f2-b7c3-4c24-bb70-3e9fe6759265 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:44.378993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f3e8b1f2-b7c3-4c24-bb70-3e9fe6759265 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:44.400785 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c4bf0bec-a576-405b-b42b-e1b39e25d255 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:44.412623 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c4bf0bec-a576-405b-b42b-e1b39e25d255 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1681 microversion: 2.1 time: 0.373053 Aug 08 14:35:44.413745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 351/730] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:44 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1681 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:44.602600 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6b6cb90d-f9f7-45a7-b9f1-8e91bdfcedc8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Action: 'create', calling method: .version_select at 0x7f9cb24abb80>, body: {"keypair": {"name": "tempest-keypair-1843379445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRE5EriwNy5tCG7HE+PZ9xfWZxouujHQ5N9BYWCm4hO4pWssNUZLr9Qjm482obUurfml+hWsF7OjMsz9e7+cp56KHGKYDx+2T09q7OIb0a73BQdkbQGY9uGE3ufW69Lyg=="}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:44.618264 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-6b6cb90d-f9f7-45a7-b9f1-8e91bdfcedc8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Getting quotas for project fa2ecaeb6faf4c1ea5eac70b19398b42. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:35:44.622288 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-6b6cb90d-f9f7-45a7-b9f1-8e91bdfcedc8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Getting quotas for user 84d2f3c3c5fb4cceabf9a35f64a1551c and project fa2ecaeb6faf4c1ea5eac70b19398b42. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:35:44.623134 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f3e8b1f2-b7c3-4c24-bb70-3e9fe6759265 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:44.633312 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f3e8b1f2-b7c3-4c24-bb70-3e9fe6759265 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.270009 Aug 08 14:35:44.634367 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 380/731] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:44 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:44.658987 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6b6cb90d-f9f7-45a7-b9f1-8e91bdfcedc8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.062463 Aug 08 14:35:44.659637 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 352/732] 10.222.0.50 () {62 vars in 1200 bytes} [Mon Aug 8 14:35:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 14:35:44.676367 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-59c14503-59ab-4721-93c3-a09c2da9f791 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:44.676850 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-59c14503-59ab-4721-93c3-a09c2da9f791 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:44.683281 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59c14503-59ab-4721-93c3-a09c2da9f791 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:44.683778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59c14503-59ab-4721-93c3-a09c2da9f791 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:44.684433 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59c14503-59ab-4721-93c3-a09c2da9f791 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:44.685640 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59c14503-59ab-4721-93c3-a09c2da9f791 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:44.686132 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59c14503-59ab-4721-93c3-a09c2da9f791 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:44.686562 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59c14503-59ab-4721-93c3-a09c2da9f791 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:44.722077 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59c14503-59ab-4721-93c3-a09c2da9f791 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:44.722295 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59c14503-59ab-4721-93c3-a09c2da9f791 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:44.722821 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-59c14503-59ab-4721-93c3-a09c2da9f791 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:44.723326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-59c14503-59ab-4721-93c3-a09c2da9f791 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lazy-loading 'fault' on Instance uuid 61b75b2c-76ff-4530-9553-9fb04db7c082 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:35:44.773542 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-59c14503-59ab-4721-93c3-a09c2da9f791 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:44.793876 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-59c14503-59ab-4721-93c3-a09c2da9f791 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1309 microversion: 2.1 time: 0.120192 Aug 08 14:35:44.812524 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 381/733] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:44 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1309 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:45.268255 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0d247db4-92a7-4596-baa5-e9e2aa399926 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:45.269252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0d247db4-92a7-4596-baa5-e9e2aa399926 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:45.275308 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0d247db4-92a7-4596-baa5-e9e2aa399926 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:45.276096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0d247db4-92a7-4596-baa5-e9e2aa399926 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:45.276597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0d247db4-92a7-4596-baa5-e9e2aa399926 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:45.277378 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0d247db4-92a7-4596-baa5-e9e2aa399926 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:45.277899 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0d247db4-92a7-4596-baa5-e9e2aa399926 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:45.278537 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0d247db4-92a7-4596-baa5-e9e2aa399926 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:45.351786 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0d247db4-92a7-4596-baa5-e9e2aa399926 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:45.361687 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0d247db4-92a7-4596-baa5-e9e2aa399926 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1510 microversion: 2.1 time: 0.097161 Aug 08 14:35:45.362395 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 353/734] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:45 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1510 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:45.435967 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e4b7311a-b29c-4d58-bf11-dd510b72ef6b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:45.436495 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e4b7311a-b29c-4d58-bf11-dd510b72ef6b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:45.443011 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b7311a-b29c-4d58-bf11-dd510b72ef6b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:45.443526 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b7311a-b29c-4d58-bf11-dd510b72ef6b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:45.443964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b7311a-b29c-4d58-bf11-dd510b72ef6b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:45.444662 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b7311a-b29c-4d58-bf11-dd510b72ef6b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:45.445291 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b7311a-b29c-4d58-bf11-dd510b72ef6b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:45.445717 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b7311a-b29c-4d58-bf11-dd510b72ef6b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:45.588756 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e4b7311a-b29c-4d58-bf11-dd510b72ef6b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:45.604157 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e4b7311a-b29c-4d58-bf11-dd510b72ef6b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1681 microversion: 2.1 time: 0.165988 Aug 08 14:35:45.604988 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 382/735] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:45 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:45.655612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e305a8cf-ffce-4ed3-aa58-1e85732ac1a9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:45.656280 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e305a8cf-ffce-4ed3-aa58-1e85732ac1a9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:45.664100 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e305a8cf-ffce-4ed3-aa58-1e85732ac1a9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:45.664918 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e305a8cf-ffce-4ed3-aa58-1e85732ac1a9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:45.665417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e305a8cf-ffce-4ed3-aa58-1e85732ac1a9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:45.666350 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e305a8cf-ffce-4ed3-aa58-1e85732ac1a9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:45.666961 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e305a8cf-ffce-4ed3-aa58-1e85732ac1a9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:45.667405 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e305a8cf-ffce-4ed3-aa58-1e85732ac1a9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:45.814593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e4b4f5f9-9dd8-4c54-94e5-4a3c46d58a9b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:45.815242 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e4b4f5f9-9dd8-4c54-94e5-4a3c46d58a9b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:45.823239 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b4f5f9-9dd8-4c54-94e5-4a3c46d58a9b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:45.823767 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b4f5f9-9dd8-4c54-94e5-4a3c46d58a9b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:45.824205 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b4f5f9-9dd8-4c54-94e5-4a3c46d58a9b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:45.824945 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b4f5f9-9dd8-4c54-94e5-4a3c46d58a9b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:45.825374 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b4f5f9-9dd8-4c54-94e5-4a3c46d58a9b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:45.825795 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b4f5f9-9dd8-4c54-94e5-4a3c46d58a9b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:45.829294 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e305a8cf-ffce-4ed3-aa58-1e85732ac1a9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:45.838397 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e305a8cf-ffce-4ed3-aa58-1e85732ac1a9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1359 microversion: 2.1 time: 0.186546 Aug 08 14:35:45.839111 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 354/736] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:45 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:45.849833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:45.864917 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b4f5f9-9dd8-4c54-94e5-4a3c46d58a9b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:45.865530 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b4f5f9-9dd8-4c54-94e5-4a3c46d58a9b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:45.866037 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e4b4f5f9-9dd8-4c54-94e5-4a3c46d58a9b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:45.866508 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-e4b4f5f9-9dd8-4c54-94e5-4a3c46d58a9b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lazy-loading 'fault' on Instance uuid 61b75b2c-76ff-4530-9553-9fb04db7c082 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:35:45.916953 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e4b4f5f9-9dd8-4c54-94e5-4a3c46d58a9b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e1243ffa724189ba7d2b9277e10afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b1fece5b548c786a495d2dc91bd8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:45.931188 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e4b4f5f9-9dd8-4c54-94e5-4a3c46d58a9b tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 200 len: 1309 microversion: 2.1 time: 0.120978 Aug 08 14:35:45.931769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 383/737] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:45 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 1309 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:46.094750 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-82443430", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f5f82ef-035c-4c6b-ae6e-53ab04cd7d05"}], "security_groups": [{"name": "tempest-securitygroup--1640604575"}], "key_name": "tempest-keypair-1843379445", "user_data": "}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:46.200179 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] validate_networks() for [('9f5f82ef-035c-4c6b-ae6e-53ab04cd7d05', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:35:46.324729 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-fa59e8e4-d1ef-4c55-986e-da29ce2e63bf req-e5c14889-41d5-4520-a568-90d0411cee99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4173a09-ab1b-40aa-818f-5954b2c1bc6a", "name": "network-vif-deleted", "tag": "23846c7c-43aa-487c-8739-8c59a0c6af7f"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:46.335022 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-fa59e8e4-d1ef-4c55-986e-da29ce2e63bf req-e5c14889-41d5-4520-a568-90d0411cee99 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:46.335535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-fa59e8e4-d1ef-4c55-986e-da29ce2e63bf req-e5c14889-41d5-4520-a568-90d0411cee99 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:46.335964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-fa59e8e4-d1ef-4c55-986e-da29ce2e63bf req-e5c14889-41d5-4520-a568-90d0411cee99 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:46.347207 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-fa59e8e4-d1ef-4c55-986e-da29ce2e63bf req-e5c14889-41d5-4520-a568-90d0411cee99 service nova] Creating event network-vif-deleted:23846c7c-43aa-487c-8739-8c59a0c6af7f for instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a on hv-cinder-85200 Aug 08 14:35:46.351942 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-fa59e8e4-d1ef-4c55-986e-da29ce2e63bf req-e5c14889-41d5-4520-a568-90d0411cee99 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031210 Aug 08 14:35:46.352541 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 384/738] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:35:46.385245 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-709d39f9-458b-480d-9708-f5725f53f979 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:46.385938 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-709d39f9-458b-480d-9708-f5725f53f979 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:46.392452 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-709d39f9-458b-480d-9708-f5725f53f979 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:46.392935 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-709d39f9-458b-480d-9708-f5725f53f979 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:46.393365 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-709d39f9-458b-480d-9708-f5725f53f979 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:46.394171 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-709d39f9-458b-480d-9708-f5725f53f979 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:46.394642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-709d39f9-458b-480d-9708-f5725f53f979 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:46.395049 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-709d39f9-458b-480d-9708-f5725f53f979 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:46.617920 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:35:46.618352 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:35:46.621540 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:35:46.622123 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:35:46.622550 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:35:46.633886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:46.634508 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:46.635382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:46.637105 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:46.637671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:46.638198 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:46.655843 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Getting quotas for project fa2ecaeb6faf4c1ea5eac70b19398b42. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:35:46.660432 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Getting quotas for user 84d2f3c3c5fb4cceabf9a35f64a1551c and project fa2ecaeb6faf4c1ea5eac70b19398b42. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:35:46.672722 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:35:46.675358 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:35:46.679984 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-709d39f9-458b-480d-9708-f5725f53f979 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:46.688457 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-709d39f9-458b-480d-9708-f5725f53f979 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1226 microversion: 2.1 time: 0.307513 Aug 08 14:35:46.689266 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 385/739] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:46 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1226 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:46.694671 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e41d75e8-c078-40b7-9f98-43f7ef7db7f0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:46.695451 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e41d75e8-c078-40b7-9f98-43f7ef7db7f0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:46.702040 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e41d75e8-c078-40b7-9f98-43f7ef7db7f0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:46.702526 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e41d75e8-c078-40b7-9f98-43f7ef7db7f0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:46.703408 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e41d75e8-c078-40b7-9f98-43f7ef7db7f0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:46.704318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e41d75e8-c078-40b7-9f98-43f7ef7db7f0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:46.704825 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e41d75e8-c078-40b7-9f98-43f7ef7db7f0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:46.705335 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e41d75e8-c078-40b7-9f98-43f7ef7db7f0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:46.721862 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-703a7174-770a-4ad3-81e1-66120444f620 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.631636 Aug 08 14:35:46.722659 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 355/740] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Aug 8 14:35:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 14:35:46.733549 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-44d0ce10-02b2-4a19-985b-49800a7478fc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:46.734149 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-44d0ce10-02b2-4a19-985b-49800a7478fc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:46.885524 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-44d0ce10-02b2-4a19-985b-49800a7478fc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:46.890475 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e41d75e8-c078-40b7-9f98-43f7ef7db7f0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:46.893592 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-44d0ce10-02b2-4a19-985b-49800a7478fc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:46.895398 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-44d0ce10-02b2-4a19-985b-49800a7478fc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:46.896666 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-44d0ce10-02b2-4a19-985b-49800a7478fc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1280 microversion: 2.20 time: 0.166970 Aug 08 14:35:46.897586 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 356/741] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:46 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1280 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:35:46.898713 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e41d75e8-c078-40b7-9f98-43f7ef7db7f0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1681 microversion: 2.1 time: 0.208416 Aug 08 14:35:46.899500 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 386/742] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:46 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:46.907147 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7c26fc48-8e96-4290-86d6-9937e9e21faf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:46.907878 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7c26fc48-8e96-4290-86d6-9937e9e21faf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:46.917154 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c26fc48-8e96-4290-86d6-9937e9e21faf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:46.917649 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c26fc48-8e96-4290-86d6-9937e9e21faf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:46.918090 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c26fc48-8e96-4290-86d6-9937e9e21faf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:46.918793 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c26fc48-8e96-4290-86d6-9937e9e21faf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:46.919283 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c26fc48-8e96-4290-86d6-9937e9e21faf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:46.919709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c26fc48-8e96-4290-86d6-9937e9e21faf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:46.954871 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0d72f17f-7863-43a1-a329-1b9b0fdbd974 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:46.955616 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-0d72f17f-7863-43a1-a329-1b9b0fdbd974 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] [instance: 61b75b2c-76ff-4530-9553-9fb04db7c082] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:46.964533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d72f17f-7863-43a1-a329-1b9b0fdbd974 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:46.965482 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d72f17f-7863-43a1-a329-1b9b0fdbd974 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:46.967157 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d72f17f-7863-43a1-a329-1b9b0fdbd974 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:46.968101 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d72f17f-7863-43a1-a329-1b9b0fdbd974 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:46.968814 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d72f17f-7863-43a1-a329-1b9b0fdbd974 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:46.969431 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d72f17f-7863-43a1-a329-1b9b0fdbd974 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:46.991044 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-0d72f17f-7863-43a1-a329-1b9b0fdbd974 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] HTTP exception thrown: Instance 61b75b2c-76ff-4530-9553-9fb04db7c082 could not be found. Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0d72f17f-7863-43a1-a329-1b9b0fdbd974 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Request method failure captured: Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 HTTP/1.1 Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R6X8HzSCKcEAD0mIYWiIURNB8GnpLaLUhczqTn-MyUqt8b1OSNLzBxt-1Z5EDIuZr3TcNd1ngVCerFhjK8UFw2VdbgR2rE73qHB4TD63bY5u4eRNcfWskNM4wPF6j5V9FNUb9MAKFC0gUQOJb49mNKA6lBGcNqPYC-hzMPUSjy_NDM Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 693b1fece5b548c786a495d2dc91bd8a Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1757663352 Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:35:46.993587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:35:46.995434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/693b1fece5b548c786a495d2dc91bd8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_693b1fece5b548c786a495d2dc91bd8a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/693b1fece5b548c786a495d2dc91bd8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/693b1fece5b548c786a495d2dc91bd8a"}]}] Aug 08 14:35:46.995434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-VolumesSnapshotTestJSON-1757663352 Aug 08 14:35:46.995434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 693b1fece5b548c786a495d2dc91bd8a Aug 08 14:35:46.995434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1757663352 Aug 08 14:35:46.995434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-VolumesSnapshotTestJSON-1757663352-project Aug 08 14:35:46.995434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:35:46.995434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:35:46.995434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 57e1243ffa724189ba7d2b9277e10afd Aug 08 14:35:46.995434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-VolumesSnapshotTestJSON-1757663352-project Aug 08 14:35:46.995434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:35:46.995434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance 61b75b2c-76ff-4530-9553-9fb04db7c082 could not be found. Aug 08 14:35:46.995434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': '61b75b2c-76ff-4530-9553-9fb04db7c082'} Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61b75b2c-76ff-4530-9553-9fb04db7c082 could not be found. Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:35:46.996427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61b75b2c-76ff-4530-9553-9fb04db7c082 could not be found. Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61b75b2c-76ff-4530-9553-9fb04db7c082 could not be found. Aug 08 14:35:46.997579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:46.998653 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0d72f17f-7863-43a1-a329-1b9b0fdbd974 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] Returning 404 to user: Instance 61b75b2c-76ff-4530-9553-9fb04db7c082 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:35:46.998653 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0d72f17f-7863-43a1-a329-1b9b0fdbd974 tempest-VolumesSnapshotTestJSON-1757663352 tempest-VolumesSnapshotTestJSON-1757663352-project] 10.222.0.50 "GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082" status: 404 len: 111 microversion: 2.1 time: 0.045562 Aug 08 14:35:47.001131 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 387/743] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:46 2022] GET /compute/v2.1/servers/61b75b2c-76ff-4530-9553-9fb04db7c082 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 14:35:47.105404 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7c26fc48-8e96-4290-86d6-9937e9e21faf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:47.114167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7c26fc48-8e96-4290-86d6-9937e9e21faf tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1548 microversion: 2.1 time: 0.215358 Aug 08 14:35:47.115647 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 357/744] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:46 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1548 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:47.134667 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-546f7196-595a-4906-93ec-99039992807f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:47.135311 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-546f7196-595a-4906-93ec-99039992807f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:47.142289 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-546f7196-595a-4906-93ec-99039992807f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:47.142786 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-546f7196-595a-4906-93ec-99039992807f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:47.143267 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-546f7196-595a-4906-93ec-99039992807f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:47.143963 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-546f7196-595a-4906-93ec-99039992807f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:47.144421 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-546f7196-595a-4906-93ec-99039992807f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:47.144844 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-546f7196-595a-4906-93ec-99039992807f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:47.380556 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-546f7196-595a-4906-93ec-99039992807f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:47.400397 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-546f7196-595a-4906-93ec-99039992807f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1548 microversion: 2.1 time: 0.269425 Aug 08 14:35:47.403874 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 388/745] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:47 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1548 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:47.423083 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f6446b53-62e8-4ca7-9cac-d2b2e7fe2aa2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:47.428185 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f6446b53-62e8-4ca7-9cac-d2b2e7fe2aa2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:47.428987 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f6446b53-62e8-4ca7-9cac-d2b2e7fe2aa2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Searching by: {'deleted': False, 'project_id': '90d6ef85228f4676b9ac19e123e1462a'} {{(pid=118060) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 08 14:35:47.436522 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6446b53-62e8-4ca7-9cac-d2b2e7fe2aa2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:47.437014 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6446b53-62e8-4ca7-9cac-d2b2e7fe2aa2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:47.437454 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6446b53-62e8-4ca7-9cac-d2b2e7fe2aa2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:47.438183 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6446b53-62e8-4ca7-9cac-d2b2e7fe2aa2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:47.438639 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6446b53-62e8-4ca7-9cac-d2b2e7fe2aa2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:47.439064 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6446b53-62e8-4ca7-9cac-d2b2e7fe2aa2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:47.531389 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.multi_cell_list [None req-f6446b53-62e8-4ca7-9cac-d2b2e7fe2aa2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 08 14:35:47.587968 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:47.637521 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f6446b53-62e8-4ca7-9cac-d2b2e7fe2aa2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.218181 Aug 08 14:35:47.650495 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7fdaf3ab-75f0-46ac-aea3-fe364339243e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:47.651128 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7fdaf3ab-75f0-46ac-aea3-fe364339243e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:47.657454 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7fdaf3ab-75f0-46ac-aea3-fe364339243e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:47.657673 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 358/746] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Aug 8 14:35:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:47.658298 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7fdaf3ab-75f0-46ac-aea3-fe364339243e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:47.658786 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7fdaf3ab-75f0-46ac-aea3-fe364339243e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:47.659609 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7fdaf3ab-75f0-46ac-aea3-fe364339243e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:47.660090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7fdaf3ab-75f0-46ac-aea3-fe364339243e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:47.660625 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7fdaf3ab-75f0-46ac-aea3-fe364339243e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:47.712592 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d193c9b8-585b-4b0d-97d9-a49da6e375cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:47.713608 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d193c9b8-585b-4b0d-97d9-a49da6e375cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:47.723362 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d193c9b8-585b-4b0d-97d9-a49da6e375cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:47.724184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d193c9b8-585b-4b0d-97d9-a49da6e375cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:47.724874 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d193c9b8-585b-4b0d-97d9-a49da6e375cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:47.725748 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d193c9b8-585b-4b0d-97d9-a49da6e375cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:47.726669 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d193c9b8-585b-4b0d-97d9-a49da6e375cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:47.727269 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d193c9b8-585b-4b0d-97d9-a49da6e375cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:47.767671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d193c9b8-585b-4b0d-97d9-a49da6e375cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:47.768432 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d193c9b8-585b-4b0d-97d9-a49da6e375cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:47.769481 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d193c9b8-585b-4b0d-97d9-a49da6e375cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:47.770345 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-d193c9b8-585b-4b0d-97d9-a49da6e375cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lazy-loading 'fault' on Instance uuid d4173a09-ab1b-40aa-818f-5954b2c1bc6a {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:35:47.847982 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d193c9b8-585b-4b0d-97d9-a49da6e375cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:47.855293 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d193c9b8-585b-4b0d-97d9-a49da6e375cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 200 len: 1185 microversion: 2.1 time: 0.149282 Aug 08 14:35:47.855878 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 359/747] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:47 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 1185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:47.920380 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-93cfc22d-c881-4d15-8104-64af02fc4199 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:47.921105 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-93cfc22d-c881-4d15-8104-64af02fc4199 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:47.927196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-93cfc22d-c881-4d15-8104-64af02fc4199 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:47.927770 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-93cfc22d-c881-4d15-8104-64af02fc4199 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:47.928281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-93cfc22d-c881-4d15-8104-64af02fc4199 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:47.928987 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-93cfc22d-c881-4d15-8104-64af02fc4199 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:47.929440 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-93cfc22d-c881-4d15-8104-64af02fc4199 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:47.929865 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-93cfc22d-c881-4d15-8104-64af02fc4199 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:47.956817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7fdaf3ab-75f0-46ac-aea3-fe364339243e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:47.965930 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7fdaf3ab-75f0-46ac-aea3-fe364339243e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1548 microversion: 2.1 time: 0.319144 Aug 08 14:35:47.966512 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 389/748] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:47 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1548 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:47.971339 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4cc33201-3fd1-4744-bef2-5710ff6b6561 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:47.971948 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-4cc33201-3fd1-4744-bef2-5710ff6b6561 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:47.978317 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4cc33201-3fd1-4744-bef2-5710ff6b6561 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:47.978989 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4cc33201-3fd1-4744-bef2-5710ff6b6561 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:47.979596 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4cc33201-3fd1-4744-bef2-5710ff6b6561 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:47.980375 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4cc33201-3fd1-4744-bef2-5710ff6b6561 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:47.980905 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4cc33201-3fd1-4744-bef2-5710ff6b6561 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:47.981407 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4cc33201-3fd1-4744-bef2-5710ff6b6561 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:48.009251 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-93cfc22d-c881-4d15-8104-64af02fc4199 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:48.022277 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-93cfc22d-c881-4d15-8104-64af02fc4199 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:48.024290 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-93cfc22d-c881-4d15-8104-64af02fc4199 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:48.025423 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-93cfc22d-c881-4d15-8104-64af02fc4199 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1332 microversion: 2.20 time: 0.109150 Aug 08 14:35:48.026136 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 360/749] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:47 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:35:48.197768 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4cc33201-3fd1-4744-bef2-5710ff6b6561 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:48.208836 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-4cc33201-3fd1-4744-bef2-5710ff6b6561 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1681 microversion: 2.1 time: 0.241250 Aug 08 14:35:48.209434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 390/750] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:47 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:48.618956 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-babd8c10-5de6-4bbc-839b-279b4d737b60 req-6a878373-f6c5-4c77-a7e2-2bad59431748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70", "name": "network-vif-deleted", "tag": "18cae069-68b0-4e95-807f-a1cd956485f8"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:48.640471 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-babd8c10-5de6-4bbc-839b-279b4d737b60 req-6a878373-f6c5-4c77-a7e2-2bad59431748 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:48.641396 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-babd8c10-5de6-4bbc-839b-279b4d737b60 req-6a878373-f6c5-4c77-a7e2-2bad59431748 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:48.642653 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-babd8c10-5de6-4bbc-839b-279b4d737b60 req-6a878373-f6c5-4c77-a7e2-2bad59431748 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:48.686437 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-babd8c10-5de6-4bbc-839b-279b4d737b60 req-6a878373-f6c5-4c77-a7e2-2bad59431748 service nova] Creating event network-vif-deleted:18cae069-68b0-4e95-807f-a1cd956485f8 for instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 on hv-cinder-85200 Aug 08 14:35:48.729942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-babd8c10-5de6-4bbc-839b-279b4d737b60 req-6a878373-f6c5-4c77-a7e2-2bad59431748 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117476 Aug 08 14:35:48.732588 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 361/751] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:48.877479 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8a2162c7-7a8e-45e4-9a0a-bcfa08748cad tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:48.878109 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8a2162c7-7a8e-45e4-9a0a-bcfa08748cad tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:48.880770 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:48.888265 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a2162c7-7a8e-45e4-9a0a-bcfa08748cad tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:48.888835 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a2162c7-7a8e-45e4-9a0a-bcfa08748cad tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:48.889280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a2162c7-7a8e-45e4-9a0a-bcfa08748cad tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:48.889991 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a2162c7-7a8e-45e4-9a0a-bcfa08748cad tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:48.890446 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a2162c7-7a8e-45e4-9a0a-bcfa08748cad tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:48.890869 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a2162c7-7a8e-45e4-9a0a-bcfa08748cad tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:48.906970 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6f2f7616-2276-4153-817c-b34b4773ca66 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:48.907705 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-8a2162c7-7a8e-45e4-9a0a-bcfa08748cad tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] HTTP exception thrown: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8a2162c7-7a8e-45e4-9a0a-bcfa08748cad tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Request method failure captured: Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a HTTP/1.1 Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R5eIkBFBEHPZUzy0jaQRN0EudctGzDamlySkpvuHKye7fIn0zJp_gOVT8CxwBJ-qXab_gIKIgtXukyTNZm9BO0l78eZCj73eycltH3XmsRglEyXez2OWaZt73wjvMQI5QeutNhT6-r0yq6_qt7xkHzkploEop5qFbU_sNEXH0Lvt8s Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 8aac3d3b720c45e8817bda1fe4d2d157 Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:35:48.909270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:35:48.910777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8aac3d3b720c45e8817bda1fe4d2d157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8aac3d3b720c45e8817bda1fe4d2d157", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8aac3d3b720c45e8817bda1fe4d2d157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8aac3d3b720c45e8817bda1fe4d2d157"}]}] Aug 08 14:35:48.910777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:35:48.910777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 8aac3d3b720c45e8817bda1fe4d2d157 Aug 08 14:35:48.910777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:35:48.910777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-TestVolumeBootPattern-1214714201-project Aug 08 14:35:48.910777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:35:48.910777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:35:48.910777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 2495d3c63dc44049872afb908ca6133b Aug 08 14:35:48.910777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-TestVolumeBootPattern-1214714201-project Aug 08 14:35:48.910777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:35:48.910777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:35:48.910777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': 'd4173a09-ab1b-40aa-818f-5954b2c1bc6a'} Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:35:48.911694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:35:48.912818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:48.915624 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8a2162c7-7a8e-45e4-9a0a-bcfa08748cad tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Returning 404 to user: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:35:48.915736 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6f2f7616-2276-4153-817c-b34b4773ca66 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:48.915833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8a2162c7-7a8e-45e4-9a0a-bcfa08748cad tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 404 len: 111 microversion: 2.1 time: 0.037929 Aug 08 14:35:48.915833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 391/752] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:48 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:35:48.919380 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6f2f7616-2276-4153-817c-b34b4773ca66 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:48.920148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6f2f7616-2276-4153-817c-b34b4773ca66 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:48.920737 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6f2f7616-2276-4153-817c-b34b4773ca66 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:48.921585 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6f2f7616-2276-4153-817c-b34b4773ca66 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:48.922282 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6f2f7616-2276-4153-817c-b34b4773ca66 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:48.922956 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6f2f7616-2276-4153-817c-b34b4773ca66 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:48.948624 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-6f2f7616-2276-4153-817c-b34b4773ca66 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lazy-loading 'flavor' on Instance uuid 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:35:49.039787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1137072384", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1484870203", "security_groups": [{"name": "tempest-secgroup-smoke-95557263"}], "block_device_mapping_v2": [{"uuid": "0ba07900-fda3-4fbf-9bf5-b29bb61aa83b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7a23184-1226-4562-af07-174dc1a651ae"}]}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:49.113408 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6f2f7616-2276-4153-817c-b34b4773ca66 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "POST /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/action" status: 200 len: 32 microversion: 2.1 time: 0.212012 Aug 08 14:35:49.114299 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 362/753] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 14:35:48 2022] POST /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 14:35:49.120793 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a73fca1a-a556-4ad9-9553-9db8346546aa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:49.121895 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a73fca1a-a556-4ad9-9553-9db8346546aa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:49.131893 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a73fca1a-a556-4ad9-9553-9db8346546aa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:49.133615 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a73fca1a-a556-4ad9-9553-9db8346546aa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:49.134248 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a73fca1a-a556-4ad9-9553-9db8346546aa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:49.135185 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a73fca1a-a556-4ad9-9553-9db8346546aa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:49.135853 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a73fca1a-a556-4ad9-9553-9db8346546aa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:49.137060 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a73fca1a-a556-4ad9-9553-9db8346546aa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:49.169501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.network.neutron [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] validate_networks() for [('f7a23184-1226-4562-af07-174dc1a651ae', None, None, None, None, None)] {{(pid=118062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:35:49.691934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a73fca1a-a556-4ad9-9553-9db8346546aa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:49.701279 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a73fca1a-a556-4ad9-9553-9db8346546aa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:49.703369 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a73fca1a-a556-4ad9-9553-9db8346546aa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:49.704648 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a73fca1a-a556-4ad9-9553-9db8346546aa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1406 microversion: 2.20 time: 0.588880 Aug 08 14:35:49.705397 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 363/754] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:49 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1406 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:35:49.710480 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b074b35f-fe83-490a-9fcc-abee8c6406a0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:49.711268 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b074b35f-fe83-490a-9fcc-abee8c6406a0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:49.718200 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b074b35f-fe83-490a-9fcc-abee8c6406a0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:49.722496 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b074b35f-fe83-490a-9fcc-abee8c6406a0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:49.723016 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b074b35f-fe83-490a-9fcc-abee8c6406a0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:49.725853 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b074b35f-fe83-490a-9fcc-abee8c6406a0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:49.726423 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b074b35f-fe83-490a-9fcc-abee8c6406a0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:49.726913 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b074b35f-fe83-490a-9fcc-abee8c6406a0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:49.990209 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b074b35f-fe83-490a-9fcc-abee8c6406a0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:49.998074 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b074b35f-fe83-490a-9fcc-abee8c6406a0 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.291698 Aug 08 14:35:49.998638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 364/755] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:49 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:50.003331 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-097e1c7c-eed0-46b4-8a1c-e5b3d3712670 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:50.004161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-097e1c7c-eed0-46b4-8a1c-e5b3d3712670 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:50.010884 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-097e1c7c-eed0-46b4-8a1c-e5b3d3712670 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:50.011649 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-097e1c7c-eed0-46b4-8a1c-e5b3d3712670 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:50.012265 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-097e1c7c-eed0-46b4-8a1c-e5b3d3712670 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:50.012964 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-097e1c7c-eed0-46b4-8a1c-e5b3d3712670 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:50.013409 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-097e1c7c-eed0-46b4-8a1c-e5b3d3712670 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:50.013833 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-097e1c7c-eed0-46b4-8a1c-e5b3d3712670 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:50.030582 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Flavor limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:35:50.031010 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Image limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:35:50.031537 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Flavor pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:35:50.031953 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Image pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:35:50.032371 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:35:50.041465 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:50.042102 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:50.042384 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:50.043153 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:50.043622 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:50.044050 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:50.045008 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-097e1c7c-eed0-46b4-8a1c-e5b3d3712670 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:50.045485 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-097e1c7c-eed0-46b4-8a1c-e5b3d3712670 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:50.045914 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-097e1c7c-eed0-46b4-8a1c-e5b3d3712670 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:50.046356 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-097e1c7c-eed0-46b4-8a1c-e5b3d3712670 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lazy-loading 'fault' on Instance uuid 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:35:50.060837 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Getting quotas for project 8aac3d3b720c45e8817bda1fe4d2d157. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:35:50.064831 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Getting quotas for user 2495d3c63dc44049872afb908ca6133b and project 8aac3d3b720c45e8817bda1fe4d2d157. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:35:50.087491 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-097e1c7c-eed0-46b4-8a1c-e5b3d3712670 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:50.095031 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-097e1c7c-eed0-46b4-8a1c-e5b3d3712670 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1332 microversion: 2.1 time: 0.095183 Aug 08 14:35:50.095623 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 365/756] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:49 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:50.101412 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6803388e-aca1-4ef8-b2de-4c50ddd1caf2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a96c406-ac1f-4e73-a218-3deec53252fe"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:50.104116 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6803388e-aca1-4ef8-b2de-4c50ddd1caf2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:50.110617 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6803388e-aca1-4ef8-b2de-4c50ddd1caf2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:50.111118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6803388e-aca1-4ef8-b2de-4c50ddd1caf2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:50.111556 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6803388e-aca1-4ef8-b2de-4c50ddd1caf2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:50.112243 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6803388e-aca1-4ef8-b2de-4c50ddd1caf2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:50.112692 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6803388e-aca1-4ef8-b2de-4c50ddd1caf2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:50.113109 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6803388e-aca1-4ef8-b2de-4c50ddd1caf2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:50.122483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Going to run 1 instances... {{(pid=118062) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:35:50.124623 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ba07900-fda3-4fbf-9bf5-b29bb61aa83b',volume_size=None,volume_type=None)] {{(pid=118062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:35:50.253601 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1f284cae-4995-4849-9683-9d2805c7e643 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.218618 Aug 08 14:35:50.254201 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 392/757] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:35:49 2022] POST /compute/v2.1/servers => generated 404 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 14:35:50.265393 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a4468900-0780-4b2d-b459-b5afd6171a36 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:50.266027 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-a4468900-0780-4b2d-b459-b5afd6171a36 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:50.319733 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-a4468900-0780-4b2d-b459-b5afd6171a36 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:50.326821 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-a4468900-0780-4b2d-b459-b5afd6171a36 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1095 microversion: 2.1 time: 0.065305 Aug 08 14:35:50.327514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 393/758] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:50 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:50.728720 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e18747e3-d96a-4cc2-9350-490d27d3deee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:50.729333 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e18747e3-d96a-4cc2-9350-490d27d3deee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:50.735428 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e18747e3-d96a-4cc2-9350-490d27d3deee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:50.735907 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e18747e3-d96a-4cc2-9350-490d27d3deee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:50.736351 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e18747e3-d96a-4cc2-9350-490d27d3deee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:50.737036 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e18747e3-d96a-4cc2-9350-490d27d3deee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:50.737499 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e18747e3-d96a-4cc2-9350-490d27d3deee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:50.737928 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e18747e3-d96a-4cc2-9350-490d27d3deee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:50.872163 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e18747e3-d96a-4cc2-9350-490d27d3deee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:50.880283 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e18747e3-d96a-4cc2-9350-490d27d3deee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:50.881815 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e18747e3-d96a-4cc2-9350-490d27d3deee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:50.882921 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e18747e3-d96a-4cc2-9350-490d27d3deee tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1406 microversion: 2.20 time: 0.158201 Aug 08 14:35:50.883513 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 394/759] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:50 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:35:51.020021 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-de9fda65-dada-4714-9f69-8dd188349860 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:51.021119 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-de9fda65-dada-4714-9f69-8dd188349860 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:51.027554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-de9fda65-dada-4714-9f69-8dd188349860 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:51.028034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-de9fda65-dada-4714-9f69-8dd188349860 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:51.028471 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-de9fda65-dada-4714-9f69-8dd188349860 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:51.029155 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-de9fda65-dada-4714-9f69-8dd188349860 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:51.029617 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-de9fda65-dada-4714-9f69-8dd188349860 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:51.030039 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-de9fda65-dada-4714-9f69-8dd188349860 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:51.159798 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-de9fda65-dada-4714-9f69-8dd188349860 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:51.168755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-de9fda65-dada-4714-9f69-8dd188349860 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.152570 Aug 08 14:35:51.169317 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 395/760] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:51 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:51.180208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e806eef7-cd10-496d-81d7-a66ed0173861 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:51.180208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e806eef7-cd10-496d-81d7-a66ed0173861 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:51.180208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e806eef7-cd10-496d-81d7-a66ed0173861 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:51.180535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e806eef7-cd10-496d-81d7-a66ed0173861 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:51.180881 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e806eef7-cd10-496d-81d7-a66ed0173861 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:51.181559 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e806eef7-cd10-496d-81d7-a66ed0173861 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:51.182005 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e806eef7-cd10-496d-81d7-a66ed0173861 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:51.182421 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e806eef7-cd10-496d-81d7-a66ed0173861 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:51.212337 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e806eef7-cd10-496d-81d7-a66ed0173861 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:51.212807 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e806eef7-cd10-496d-81d7-a66ed0173861 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:51.213270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e806eef7-cd10-496d-81d7-a66ed0173861 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:51.213714 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-e806eef7-cd10-496d-81d7-a66ed0173861 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lazy-loading 'fault' on Instance uuid 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:35:51.257226 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-e806eef7-cd10-496d-81d7-a66ed0173861 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:51.264681 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e806eef7-cd10-496d-81d7-a66ed0173861 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 200 len: 1332 microversion: 2.1 time: 0.094362 Aug 08 14:35:51.265249 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 396/761] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:51 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:51.346678 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-342e1f0e-3e50-4b55-82fe-47b868838ec1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:51.347295 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-342e1f0e-3e50-4b55-82fe-47b868838ec1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:51.353854 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-342e1f0e-3e50-4b55-82fe-47b868838ec1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:51.354327 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-342e1f0e-3e50-4b55-82fe-47b868838ec1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:51.354762 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-342e1f0e-3e50-4b55-82fe-47b868838ec1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:51.355472 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-342e1f0e-3e50-4b55-82fe-47b868838ec1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:51.355920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-342e1f0e-3e50-4b55-82fe-47b868838ec1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:51.356336 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-342e1f0e-3e50-4b55-82fe-47b868838ec1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:51.415708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-342e1f0e-3e50-4b55-82fe-47b868838ec1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:51.423016 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-342e1f0e-3e50-4b55-82fe-47b868838ec1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1145 microversion: 2.1 time: 0.080173 Aug 08 14:35:51.423589 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 397/762] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:51 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:51.882683 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6803388e-aca1-4ef8-b2de-4c50ddd1caf2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "POST /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.784866 Aug 08 14:35:51.896036 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 366/763] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 14:35:50 2022] POST /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments => generated 194 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:51.906359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8a9e88ae-5df2-4082-a706-0a52942e8113 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:51.906981 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8a9e88ae-5df2-4082-a706-0a52942e8113 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:51.917282 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a9e88ae-5df2-4082-a706-0a52942e8113 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:51.917786 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a9e88ae-5df2-4082-a706-0a52942e8113 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:51.918228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a9e88ae-5df2-4082-a706-0a52942e8113 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:51.918964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a9e88ae-5df2-4082-a706-0a52942e8113 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:51.922067 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a9e88ae-5df2-4082-a706-0a52942e8113 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:51.922527 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8a9e88ae-5df2-4082-a706-0a52942e8113 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:52.106068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8a9e88ae-5df2-4082-a706-0a52942e8113 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:52.114047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8a9e88ae-5df2-4082-a706-0a52942e8113 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:52.115614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8a9e88ae-5df2-4082-a706-0a52942e8113 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:52.116733 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8a9e88ae-5df2-4082-a706-0a52942e8113 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1406 microversion: 2.20 time: 0.215425 Aug 08 14:35:52.117288 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 398/764] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:51 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:35:52.197128 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-24086497-8325-4713-bf07-f965b3fd5a2e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:52.198163 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-24086497-8325-4713-bf07-f965b3fd5a2e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:52.204885 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-24086497-8325-4713-bf07-f965b3fd5a2e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:52.205643 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-24086497-8325-4713-bf07-f965b3fd5a2e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:52.206078 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-24086497-8325-4713-bf07-f965b3fd5a2e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:52.206774 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-24086497-8325-4713-bf07-f965b3fd5a2e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:52.207418 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-24086497-8325-4713-bf07-f965b3fd5a2e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:52.208392 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-24086497-8325-4713-bf07-f965b3fd5a2e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:52.303430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f7fbf7dc-388e-442a-b547-fbfc97b8b65b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:52.304097 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f7fbf7dc-388e-442a-b547-fbfc97b8b65b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:52.328271 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f7fbf7dc-388e-442a-b547-fbfc97b8b65b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:52.330481 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f7fbf7dc-388e-442a-b547-fbfc97b8b65b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:52.330934 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f7fbf7dc-388e-442a-b547-fbfc97b8b65b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:52.331755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f7fbf7dc-388e-442a-b547-fbfc97b8b65b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:52.332143 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f7fbf7dc-388e-442a-b547-fbfc97b8b65b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:52.332564 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f7fbf7dc-388e-442a-b547-fbfc97b8b65b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:52.375236 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-f7fbf7dc-388e-442a-b547-fbfc97b8b65b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] HTTP exception thrown: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f7fbf7dc-388e-442a-b547-fbfc97b8b65b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Request method failure captured: Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 HTTP/1.1 Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4nDHzBnzio2VZ6ciHSRMNEEHFIYRjyMTvKRDfIH2F_niI0FcU0ZqBeBBZkKpUdHOb90TorX284g0qMdisJyL77Y3j06R-x49-mqWZufa0BFWwlg29tIQoalg1p609ZLEly-KDP4mLoxCO4eWlqZVpPuU5-IPf0H50niq4AklVZ208 Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:35:52.389777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:35:52.391210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc86120e53145328dd430f542e73182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc86120e53145328dd430f542e73182", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}] Aug 08 14:35:52.391210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:35:52.391210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:35:52.391210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:35:52.391210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:35:52.391210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:35:52.391210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:35:52.391210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 48a91f6797cc4604ba2606e0549234d0 Aug 08 14:35:52.391210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:35:52.391210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:35:52.391210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:35:52.391210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': '1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70'} Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:35:52.391920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:35:52.393127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:35:52.397166 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f7fbf7dc-388e-442a-b547-fbfc97b8b65b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Returning 404 to user: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:35:52.400856 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f7fbf7dc-388e-442a-b547-fbfc97b8b65b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 404 len: 111 microversion: 2.1 time: 0.108157 Aug 08 14:35:52.404120 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 399/765] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:52 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:35:52.411632 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-457af815-dd58-4489-aa4e-3a262b501429 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '.version_select at 0x7f9cb26d93a0>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:52.463209 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-457af815-dd58-4489-aa4e-3a262b501429 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200180953" status: 202 len: 0 microversion: 2.1 time: 0.055602 Aug 08 14:35:52.463789 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 400/766] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Aug 8 14:35:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200180953 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:35:52.471762 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-37ef83ac-a968-4f1a-b9d3-d5fb4b0a1e67 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:52.472380 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-37ef83ac-a968-4f1a-b9d3-d5fb4b0a1e67 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:52.502998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-37ef83ac-a968-4f1a-b9d3-d5fb4b0a1e67 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:52.503736 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-37ef83ac-a968-4f1a-b9d3-d5fb4b0a1e67 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:52.504373 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-37ef83ac-a968-4f1a-b9d3-d5fb4b0a1e67 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:52.505809 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-37ef83ac-a968-4f1a-b9d3-d5fb4b0a1e67 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:52.506421 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-37ef83ac-a968-4f1a-b9d3-d5fb4b0a1e67 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:52.506994 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-37ef83ac-a968-4f1a-b9d3-d5fb4b0a1e67 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:52.645666 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-24086497-8325-4713-bf07-f965b3fd5a2e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:52.654671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-24086497-8325-4713-bf07-f965b3fd5a2e tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.468126 Aug 08 14:35:52.655580 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 367/767] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:52 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:52.660378 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-a49ce36e-de34-41dc-b35f-4f4be295a714 req-b1271663-7ed2-49d5-9b73-88430aeea6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79aaf7b-bbdb-42b5-a337-89102612ff93", "tag": "9bfd7cef-c545-4cf2-8212-293910501379"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:52.673744 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-a49ce36e-de34-41dc-b35f-4f4be295a714 req-b1271663-7ed2-49d5-9b73-88430aeea6e6 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:52.674782 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-a49ce36e-de34-41dc-b35f-4f4be295a714 req-b1271663-7ed2-49d5-9b73-88430aeea6e6 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:52.675474 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-a49ce36e-de34-41dc-b35f-4f4be295a714 req-b1271663-7ed2-49d5-9b73-88430aeea6e6 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:52.677322 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-37ef83ac-a968-4f1a-b9d3-d5fb4b0a1e67 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:52.686420 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-37ef83ac-a968-4f1a-b9d3-d5fb4b0a1e67 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1201 microversion: 2.1 time: 0.221581 Aug 08 14:35:52.687001 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 401/768] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:52 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1201 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:52.702797 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-a49ce36e-de34-41dc-b35f-4f4be295a714 req-b1271663-7ed2-49d5-9b73-88430aeea6e6 service nova] Creating event network-changed:9bfd7cef-c545-4cf2-8212-293910501379 for instance c79aaf7b-bbdb-42b5-a337-89102612ff93 on hv-cinder-85200 Aug 08 14:35:52.708494 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-a49ce36e-de34-41dc-b35f-4f4be295a714 req-b1271663-7ed2-49d5-9b73-88430aeea6e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051510 Aug 08 14:35:52.709264 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 368/769] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:53.141440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-db5f2fa8-d3cc-47c7-a67a-c4ac719a1aaf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:53.141972 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-db5f2fa8-d3cc-47c7-a67a-c4ac719a1aaf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:53.148791 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db5f2fa8-d3cc-47c7-a67a-c4ac719a1aaf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:53.149279 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db5f2fa8-d3cc-47c7-a67a-c4ac719a1aaf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:53.149708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db5f2fa8-d3cc-47c7-a67a-c4ac719a1aaf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:53.150625 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db5f2fa8-d3cc-47c7-a67a-c4ac719a1aaf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:53.151319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db5f2fa8-d3cc-47c7-a67a-c4ac719a1aaf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:53.151972 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db5f2fa8-d3cc-47c7-a67a-c4ac719a1aaf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:53.368348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-db5f2fa8-d3cc-47c7-a67a-c4ac719a1aaf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:53.378618 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-db5f2fa8-d3cc-47c7-a67a-c4ac719a1aaf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:53.381156 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-db5f2fa8-d3cc-47c7-a67a-c4ac719a1aaf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:53.382347 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-db5f2fa8-d3cc-47c7-a67a-c4ac719a1aaf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1406 microversion: 2.20 time: 0.245012 Aug 08 14:35:53.395759 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 402/770] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:53 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:35:53.575899 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-284b2151-bd4e-4bd0-8385-e603139914b3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Action: 'create', calling method: .version_select at 0x7f9cb240e280>, body: {"keypair": {"name": "tempest-keypair-423480582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3BbPdZ0zQQyqd9Mwe2XlGB1IeBJ4/r/zzrDWMsd6t98cRnV2gQkMWd2dbFKlia+4AcIcfRmDW3FDOwjr8Clt8dzXWlni75AFvb2OU+qqieUgdUF2G3YEhwE4OQHED1BQ=="}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:53.594689 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-284b2151-bd4e-4bd0-8385-e603139914b3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for project cfc86120e53145328dd430f542e73182. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:35:53.601249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-284b2151-bd4e-4bd0-8385-e603139914b3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for user 48a91f6797cc4604ba2606e0549234d0 and project cfc86120e53145328dd430f542e73182. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:35:53.604399 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:53.634723 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-284b2151-bd4e-4bd0-8385-e603139914b3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064703 Aug 08 14:35:53.635880 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 369/771] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 14:35:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:53.679533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-33986205-0cdd-4b77-929f-688709ea1b70 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:53.680198 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-33986205-0cdd-4b77-929f-688709ea1b70 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:53.692936 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-33986205-0cdd-4b77-929f-688709ea1b70 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:53.693524 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-33986205-0cdd-4b77-929f-688709ea1b70 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:53.694223 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-33986205-0cdd-4b77-929f-688709ea1b70 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:53.694933 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-33986205-0cdd-4b77-929f-688709ea1b70 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:53.695416 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-33986205-0cdd-4b77-929f-688709ea1b70 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:53.695839 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-33986205-0cdd-4b77-929f-688709ea1b70 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:53.709959 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e57fefb3-e17a-42a2-80b5-25d116f41f39 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:53.710814 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e57fefb3-e17a-42a2-80b5-25d116f41f39 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:53.717667 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e57fefb3-e17a-42a2-80b5-25d116f41f39 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:53.718421 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e57fefb3-e17a-42a2-80b5-25d116f41f39 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:53.719384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e57fefb3-e17a-42a2-80b5-25d116f41f39 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:53.720361 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e57fefb3-e17a-42a2-80b5-25d116f41f39 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:53.721038 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e57fefb3-e17a-42a2-80b5-25d116f41f39 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:53.722364 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e57fefb3-e17a-42a2-80b5-25d116f41f39 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:53.825605 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e57fefb3-e17a-42a2-80b5-25d116f41f39 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:53.837472 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e57fefb3-e17a-42a2-80b5-25d116f41f39 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1211 microversion: 2.1 time: 0.132433 Aug 08 14:35:53.855417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 370/772] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:53 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1211 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:53.947638 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-33986205-0cdd-4b77-929f-688709ea1b70 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:53.963033 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-33986205-0cdd-4b77-929f-688709ea1b70 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.287554 Aug 08 14:35:53.963660 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 403/773] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:53 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:54.407662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-731042ff-8945-4265-a82c-8463319b1c60 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:54.408448 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-731042ff-8945-4265-a82c-8463319b1c60 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:54.415311 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-731042ff-8945-4265-a82c-8463319b1c60 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:54.415792 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-731042ff-8945-4265-a82c-8463319b1c60 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:54.416220 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-731042ff-8945-4265-a82c-8463319b1c60 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:54.416903 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-731042ff-8945-4265-a82c-8463319b1c60 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:54.417349 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-731042ff-8945-4265-a82c-8463319b1c60 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:54.417827 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-731042ff-8945-4265-a82c-8463319b1c60 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:54.555797 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-731042ff-8945-4265-a82c-8463319b1c60 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:54.563635 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-731042ff-8945-4265-a82c-8463319b1c60 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:54.565383 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-731042ff-8945-4265-a82c-8463319b1c60 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:54.566460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-731042ff-8945-4265-a82c-8463319b1c60 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1406 microversion: 2.20 time: 0.162758 Aug 08 14:35:54.567168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 371/774] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:54 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:35:54.864955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7f2f002b-9ebc-43f2-927e-33dc2500759d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:54.865751 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7f2f002b-9ebc-43f2-927e-33dc2500759d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:54.873164 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f2f002b-9ebc-43f2-927e-33dc2500759d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:54.874530 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f2f002b-9ebc-43f2-927e-33dc2500759d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:54.876681 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f2f002b-9ebc-43f2-927e-33dc2500759d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:54.877694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f2f002b-9ebc-43f2-927e-33dc2500759d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:54.878354 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f2f002b-9ebc-43f2-927e-33dc2500759d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:54.879028 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f2f002b-9ebc-43f2-927e-33dc2500759d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:54.988128 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-897e50f6-dd07-4640-b6e8-b56a819edb29 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:54.989681 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-897e50f6-dd07-4640-b6e8-b56a819edb29 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:54.998450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-897e50f6-dd07-4640-b6e8-b56a819edb29 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:54.999242 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-897e50f6-dd07-4640-b6e8-b56a819edb29 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:54.999938 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-897e50f6-dd07-4640-b6e8-b56a819edb29 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:55.001009 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-897e50f6-dd07-4640-b6e8-b56a819edb29 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:55.002224 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-897e50f6-dd07-4640-b6e8-b56a819edb29 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:55.003149 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-897e50f6-dd07-4640-b6e8-b56a819edb29 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:55.138681 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7f2f002b-9ebc-43f2-927e-33dc2500759d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:55.143004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=100 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:55.150329 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7f2f002b-9ebc-43f2-927e-33dc2500759d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1277 microversion: 2.1 time: 0.291727 Aug 08 14:35:55.151338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 404/775] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:54 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1277 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:55.206810 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-897e50f6-dd07-4640-b6e8-b56a819edb29 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:55.215427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-897e50f6-dd07-4640-b6e8-b56a819edb29 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.234144 Aug 08 14:35:55.215997 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 372/776] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:54 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:55.644505 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0c8eb164-e6a1-4e4a-bc2c-1cff0132ad1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:55.645223 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-0c8eb164-e6a1-4e4a-bc2c-1cff0132ad1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:55.651462 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c8eb164-e6a1-4e4a-bc2c-1cff0132ad1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:55.651944 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c8eb164-e6a1-4e4a-bc2c-1cff0132ad1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:55.652376 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c8eb164-e6a1-4e4a-bc2c-1cff0132ad1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:55.653066 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c8eb164-e6a1-4e4a-bc2c-1cff0132ad1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:55.653545 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c8eb164-e6a1-4e4a-bc2c-1cff0132ad1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:55.653963 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c8eb164-e6a1-4e4a-bc2c-1cff0132ad1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:55.788853 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-0c8eb164-e6a1-4e4a-bc2c-1cff0132ad1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:55.798495 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-0c8eb164-e6a1-4e4a-bc2c-1cff0132ad1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:55.800100 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-0c8eb164-e6a1-4e4a-bc2c-1cff0132ad1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:55.801216 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0c8eb164-e6a1-4e4a-bc2c-1cff0132ad1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1406 microversion: 2.20 time: 0.215987 Aug 08 14:35:55.802292 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 405/777] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:55 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:35:55.971543 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1751718636", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fc22420-3005-4d46-a261-c4b4ae68cba2"}], "security_groups": [{"name": "tempest-securitygroup--1607881385"}], "key_name": "tempest-keypair-423480582", "user_data": "}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:56.016020 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-cfe4a573-6689-425e-83c2-6243158db18c req-e941dcac-8801-4e2f-944a-ded6904b9469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb38e896-d3ab-4655-bcec-eef6e42c4de4", "tag": "a2298513-6cdb-40b2-88dd-cf9f7ad6d82e"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:35:56.028602 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-cfe4a573-6689-425e-83c2-6243158db18c req-e941dcac-8801-4e2f-944a-ded6904b9469 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:56.029278 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-cfe4a573-6689-425e-83c2-6243158db18c req-e941dcac-8801-4e2f-944a-ded6904b9469 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:56.029888 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-cfe4a573-6689-425e-83c2-6243158db18c req-e941dcac-8801-4e2f-944a-ded6904b9469 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:56.044694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-cfe4a573-6689-425e-83c2-6243158db18c req-e941dcac-8801-4e2f-944a-ded6904b9469 service nova] Creating event network-changed:a2298513-6cdb-40b2-88dd-cf9f7ad6d82e for instance bb38e896-d3ab-4655-bcec-eef6e42c4de4 on hv-cinder-85200 Aug 08 14:35:56.050641 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-cfe4a573-6689-425e-83c2-6243158db18c req-e941dcac-8801-4e2f-944a-ded6904b9469 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038318 Aug 08 14:35:56.052345 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 406/778] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:35:56.107752 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] validate_networks() for [('3fc22420-3005-4d46-a261-c4b4ae68cba2', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:35:56.174544 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3115b731-4018-4259-b7b8-7deac2bb567f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:56.175516 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3115b731-4018-4259-b7b8-7deac2bb567f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:56.190459 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3115b731-4018-4259-b7b8-7deac2bb567f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:56.193505 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3115b731-4018-4259-b7b8-7deac2bb567f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:56.195746 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3115b731-4018-4259-b7b8-7deac2bb567f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:56.196602 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3115b731-4018-4259-b7b8-7deac2bb567f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:56.197156 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3115b731-4018-4259-b7b8-7deac2bb567f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:56.200588 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3115b731-4018-4259-b7b8-7deac2bb567f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:56.475258 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3115b731-4018-4259-b7b8-7deac2bb567f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:56.483516 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3115b731-4018-4259-b7b8-7deac2bb567f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1277 microversion: 2.1 time: 0.315444 Aug 08 14:35:56.484100 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 407/779] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:56 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1277 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:56.489459 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3714055c-38af-41c5-947c-fabe5a29cde9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:56.490211 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3714055c-38af-41c5-947c-fabe5a29cde9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:56.496742 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3714055c-38af-41c5-947c-fabe5a29cde9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:56.497875 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3714055c-38af-41c5-947c-fabe5a29cde9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:56.498391 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3714055c-38af-41c5-947c-fabe5a29cde9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:56.499653 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3714055c-38af-41c5-947c-fabe5a29cde9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:56.500356 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3714055c-38af-41c5-947c-fabe5a29cde9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:56.501007 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3714055c-38af-41c5-947c-fabe5a29cde9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:56.673374 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:35:56.673826 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:35:56.674300 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:35:56.674858 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:35:56.675321 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:35:56.684041 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:56.684515 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:56.684979 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:56.685709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:56.686161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:56.686586 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:56.695645 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3714055c-38af-41c5-947c-fabe5a29cde9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:56.703700 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3714055c-38af-41c5-947c-fabe5a29cde9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.218252 Aug 08 14:35:56.703873 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for project cfc86120e53145328dd430f542e73182. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:35:56.704271 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 408/780] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:56 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:56.708640 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for user 48a91f6797cc4604ba2606e0549234d0 and project cfc86120e53145328dd430f542e73182. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:35:56.719828 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:35:56.722091 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:35:56.768249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-450e1cfd-8ade-4617-b837-0577b87f5cf7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.800855 Aug 08 14:35:56.768820 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 373/781] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:35:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:35:56.780181 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-80a313cb-6be2-40e3-9a9c-bab17e31a295 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:56.780794 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-80a313cb-6be2-40e3-9a9c-bab17e31a295 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:56.824473 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8cbb277a-4b22-4226-baf7-6d492cbddab2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:56.825228 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8cbb277a-4b22-4226-baf7-6d492cbddab2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:56.832336 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8cbb277a-4b22-4226-baf7-6d492cbddab2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:56.833403 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8cbb277a-4b22-4226-baf7-6d492cbddab2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:56.834063 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8cbb277a-4b22-4226-baf7-6d492cbddab2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:56.834770 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8cbb277a-4b22-4226-baf7-6d492cbddab2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:56.835410 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8cbb277a-4b22-4226-baf7-6d492cbddab2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:56.835838 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8cbb277a-4b22-4226-baf7-6d492cbddab2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:56.839668 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-80a313cb-6be2-40e3-9a9c-bab17e31a295 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:56.846568 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-80a313cb-6be2-40e3-9a9c-bab17e31a295 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1241 microversion: 2.1 time: 0.070198 Aug 08 14:35:56.851693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:35:56.860220 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 409/782] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:56 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:56.977998 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8cbb277a-4b22-4226-baf7-6d492cbddab2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:56.986079 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8cbb277a-4b22-4226-baf7-6d492cbddab2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:56.987635 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8cbb277a-4b22-4226-baf7-6d492cbddab2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:56.988745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8cbb277a-4b22-4226-baf7-6d492cbddab2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1406 microversion: 2.20 time: 0.169275 Aug 08 14:35:56.990209 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 374/783] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:56 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:35:57.504838 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3e655f0b-eac4-4b87-8847-7a1b4f924762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:57.505446 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3e655f0b-eac4-4b87-8847-7a1b4f924762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:57.511893 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3e655f0b-eac4-4b87-8847-7a1b4f924762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:57.512369 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3e655f0b-eac4-4b87-8847-7a1b4f924762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:57.512813 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3e655f0b-eac4-4b87-8847-7a1b4f924762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:57.513496 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3e655f0b-eac4-4b87-8847-7a1b4f924762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:57.513950 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3e655f0b-eac4-4b87-8847-7a1b4f924762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:57.514374 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3e655f0b-eac4-4b87-8847-7a1b4f924762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:57.646370 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3e655f0b-eac4-4b87-8847-7a1b4f924762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:57.653785 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3e655f0b-eac4-4b87-8847-7a1b4f924762 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1277 microversion: 2.1 time: 0.152938 Aug 08 14:35:57.654371 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 410/784] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:57 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:57.726449 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-925c354c-0073-4bcf-8115-db29d64df8b6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:57.727047 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-925c354c-0073-4bcf-8115-db29d64df8b6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:57.733454 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-925c354c-0073-4bcf-8115-db29d64df8b6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:57.733932 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-925c354c-0073-4bcf-8115-db29d64df8b6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:57.734363 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-925c354c-0073-4bcf-8115-db29d64df8b6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:57.735049 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-925c354c-0073-4bcf-8115-db29d64df8b6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:57.735520 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-925c354c-0073-4bcf-8115-db29d64df8b6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:57.735940 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-925c354c-0073-4bcf-8115-db29d64df8b6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:57.865889 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-925c354c-0073-4bcf-8115-db29d64df8b6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:57.868477 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2924e331-facb-4a59-9c1a-7d0520a1eb52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:57.869195 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2924e331-facb-4a59-9c1a-7d0520a1eb52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:57.873932 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-925c354c-0073-4bcf-8115-db29d64df8b6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.152246 Aug 08 14:35:57.880602 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 375/785] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:57 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:57.880885 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2924e331-facb-4a59-9c1a-7d0520a1eb52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:57.880885 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2924e331-facb-4a59-9c1a-7d0520a1eb52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:57.880885 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2924e331-facb-4a59-9c1a-7d0520a1eb52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:57.880885 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2924e331-facb-4a59-9c1a-7d0520a1eb52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:57.881255 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2924e331-facb-4a59-9c1a-7d0520a1eb52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:57.881255 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2924e331-facb-4a59-9c1a-7d0520a1eb52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:57.938472 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2924e331-facb-4a59-9c1a-7d0520a1eb52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:57.946137 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2924e331-facb-4a59-9c1a-7d0520a1eb52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1245 microversion: 2.1 time: 0.081536 Aug 08 14:35:57.946700 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 411/786] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:57 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:58.013336 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6454e0a1-6a63-4c76-8899-60eec8c8ffb9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:58.013936 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6454e0a1-6a63-4c76-8899-60eec8c8ffb9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:58.019895 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6454e0a1-6a63-4c76-8899-60eec8c8ffb9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:58.020856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6454e0a1-6a63-4c76-8899-60eec8c8ffb9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:58.021281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6454e0a1-6a63-4c76-8899-60eec8c8ffb9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:58.021956 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6454e0a1-6a63-4c76-8899-60eec8c8ffb9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:58.022401 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6454e0a1-6a63-4c76-8899-60eec8c8ffb9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:58.022817 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6454e0a1-6a63-4c76-8899-60eec8c8ffb9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:58.154720 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6454e0a1-6a63-4c76-8899-60eec8c8ffb9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:58.162545 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6454e0a1-6a63-4c76-8899-60eec8c8ffb9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:58.164346 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6454e0a1-6a63-4c76-8899-60eec8c8ffb9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:58.165428 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6454e0a1-6a63-4c76-8899-60eec8c8ffb9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1406 microversion: 2.20 time: 0.156087 Aug 08 14:35:58.165976 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 376/787] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:58 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:35:58.674373 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6c01a8eb-09de-47a7-9aa1-c9b0e7df8395 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:58.674920 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6c01a8eb-09de-47a7-9aa1-c9b0e7df8395 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:58.681396 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c01a8eb-09de-47a7-9aa1-c9b0e7df8395 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:58.681885 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c01a8eb-09de-47a7-9aa1-c9b0e7df8395 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:58.682329 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c01a8eb-09de-47a7-9aa1-c9b0e7df8395 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:58.683043 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c01a8eb-09de-47a7-9aa1-c9b0e7df8395 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:58.683516 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c01a8eb-09de-47a7-9aa1-c9b0e7df8395 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:58.683946 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c01a8eb-09de-47a7-9aa1-c9b0e7df8395 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:58.816190 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6c01a8eb-09de-47a7-9aa1-c9b0e7df8395 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:58.824402 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6c01a8eb-09de-47a7-9aa1-c9b0e7df8395 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1277 microversion: 2.1 time: 0.154541 Aug 08 14:35:58.824951 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 412/788] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:58 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:58.895221 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-87c10f90-3fce-4d85-aab5-94fd07dec37a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:58.895831 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-87c10f90-3fce-4d85-aab5-94fd07dec37a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:58.902227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-87c10f90-3fce-4d85-aab5-94fd07dec37a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:58.902713 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-87c10f90-3fce-4d85-aab5-94fd07dec37a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:58.903181 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-87c10f90-3fce-4d85-aab5-94fd07dec37a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:58.903877 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-87c10f90-3fce-4d85-aab5-94fd07dec37a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:58.904334 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-87c10f90-3fce-4d85-aab5-94fd07dec37a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:58.904759 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-87c10f90-3fce-4d85-aab5-94fd07dec37a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:58.967531 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-396933d8-a926-4146-9a86-0c1ccbe1deae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:58.968093 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-396933d8-a926-4146-9a86-0c1ccbe1deae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:58.974457 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-396933d8-a926-4146-9a86-0c1ccbe1deae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:58.974946 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-396933d8-a926-4146-9a86-0c1ccbe1deae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:58.975413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-396933d8-a926-4146-9a86-0c1ccbe1deae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:58.976119 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-396933d8-a926-4146-9a86-0c1ccbe1deae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:58.976575 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-396933d8-a926-4146-9a86-0c1ccbe1deae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:58.977000 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-396933d8-a926-4146-9a86-0c1ccbe1deae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:59.048517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-396933d8-a926-4146-9a86-0c1ccbe1deae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:59.056534 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-396933d8-a926-4146-9a86-0c1ccbe1deae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1245 microversion: 2.1 time: 0.092903 Aug 08 14:35:59.057324 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 413/789] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:58 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:35:59.060192 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-87c10f90-3fce-4d85-aab5-94fd07dec37a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:59.068158 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-87c10f90-3fce-4d85-aab5-94fd07dec37a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.176811 Aug 08 14:35:59.068720 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 377/790] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:58 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:35:59.187936 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-909c3ae9-5fca-4d6c-a2df-0736f24571ae tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:59.188539 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-909c3ae9-5fca-4d6c-a2df-0736f24571ae tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:59.194536 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-909c3ae9-5fca-4d6c-a2df-0736f24571ae tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:59.195015 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-909c3ae9-5fca-4d6c-a2df-0736f24571ae tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:59.195484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-909c3ae9-5fca-4d6c-a2df-0736f24571ae tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:59.196163 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-909c3ae9-5fca-4d6c-a2df-0736f24571ae tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:59.196617 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-909c3ae9-5fca-4d6c-a2df-0736f24571ae tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:59.197036 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-909c3ae9-5fca-4d6c-a2df-0736f24571ae tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:59.352060 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-909c3ae9-5fca-4d6c-a2df-0736f24571ae tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:59.363968 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-909c3ae9-5fca-4d6c-a2df-0736f24571ae tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:59.365659 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-909c3ae9-5fca-4d6c-a2df-0736f24571ae tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:59.366839 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-909c3ae9-5fca-4d6c-a2df-0736f24571ae tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1406 microversion: 2.20 time: 0.182847 Aug 08 14:35:59.367424 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 414/791] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:35:59 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:35:59.844661 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0f495a9a-7bf5-442c-baa2-d0b7c55a8515 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:35:59.845177 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0f495a9a-7bf5-442c-baa2-d0b7c55a8515 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:35:59.851015 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0f495a9a-7bf5-442c-baa2-d0b7c55a8515 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:59.851520 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0f495a9a-7bf5-442c-baa2-d0b7c55a8515 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:59.851955 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0f495a9a-7bf5-442c-baa2-d0b7c55a8515 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:59.852629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0f495a9a-7bf5-442c-baa2-d0b7c55a8515 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:35:59.853071 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0f495a9a-7bf5-442c-baa2-d0b7c55a8515 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:35:59.853492 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0f495a9a-7bf5-442c-baa2-d0b7c55a8515 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:35:59.992284 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0f495a9a-7bf5-442c-baa2-d0b7c55a8515 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:35:59.999660 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0f495a9a-7bf5-442c-baa2-d0b7c55a8515 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1277 microversion: 2.1 time: 0.158976 Aug 08 14:36:00.000219 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 378/792] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:35:59 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:00.076962 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-68d36d07-3617-4d54-861a-7a99ae6bd784 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:00.077570 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-68d36d07-3617-4d54-861a-7a99ae6bd784 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:00.080148 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:00.085852 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-68d36d07-3617-4d54-861a-7a99ae6bd784 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:00.086345 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-68d36d07-3617-4d54-861a-7a99ae6bd784 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:00.086784 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-68d36d07-3617-4d54-861a-7a99ae6bd784 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:00.087515 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-68d36d07-3617-4d54-861a-7a99ae6bd784 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:00.088007 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-68d36d07-3617-4d54-861a-7a99ae6bd784 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:00.088437 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-68d36d07-3617-4d54-861a-7a99ae6bd784 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:00.089344 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ae6361ce-2177-4abf-a87e-8b953cbd0aa5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:00.089949 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ae6361ce-2177-4abf-a87e-8b953cbd0aa5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:00.095909 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ae6361ce-2177-4abf-a87e-8b953cbd0aa5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:00.096378 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ae6361ce-2177-4abf-a87e-8b953cbd0aa5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:00.096816 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ae6361ce-2177-4abf-a87e-8b953cbd0aa5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:00.097501 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ae6361ce-2177-4abf-a87e-8b953cbd0aa5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:00.097954 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ae6361ce-2177-4abf-a87e-8b953cbd0aa5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:00.098403 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ae6361ce-2177-4abf-a87e-8b953cbd0aa5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:00.169533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-68d36d07-3617-4d54-861a-7a99ae6bd784 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:00.181106 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-68d36d07-3617-4d54-861a-7a99ae6bd784 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1237 microversion: 2.1 time: 0.107835 Aug 08 14:36:00.181704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 415/793] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:00 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1237 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:00.277897 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ae6361ce-2177-4abf-a87e-8b953cbd0aa5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:00.286229 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ae6361ce-2177-4abf-a87e-8b953cbd0aa5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.200613 Aug 08 14:36:00.286851 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 379/794] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:00 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:00.389046 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ee083ce6-9897-4d1e-8f8d-7a91c6dfe2c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:00.389628 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ee083ce6-9897-4d1e-8f8d-7a91c6dfe2c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:00.397309 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ee083ce6-9897-4d1e-8f8d-7a91c6dfe2c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:00.397797 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ee083ce6-9897-4d1e-8f8d-7a91c6dfe2c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:00.398228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ee083ce6-9897-4d1e-8f8d-7a91c6dfe2c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:00.398927 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ee083ce6-9897-4d1e-8f8d-7a91c6dfe2c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:00.399414 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ee083ce6-9897-4d1e-8f8d-7a91c6dfe2c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:00.399832 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ee083ce6-9897-4d1e-8f8d-7a91c6dfe2c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:00.538500 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ee083ce6-9897-4d1e-8f8d-7a91c6dfe2c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:00.546814 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ee083ce6-9897-4d1e-8f8d-7a91c6dfe2c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:00.548391 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ee083ce6-9897-4d1e-8f8d-7a91c6dfe2c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:00.549501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ee083ce6-9897-4d1e-8f8d-7a91c6dfe2c5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1406 microversion: 2.20 time: 0.164410 Aug 08 14:36:00.550058 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 416/795] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:36:00 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:36:01.020813 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a517eadd-ca61-48de-82dc-9517462e929c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:01.021535 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a517eadd-ca61-48de-82dc-9517462e929c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:01.027934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a517eadd-ca61-48de-82dc-9517462e929c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:01.028425 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a517eadd-ca61-48de-82dc-9517462e929c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:01.028860 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a517eadd-ca61-48de-82dc-9517462e929c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:01.029565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a517eadd-ca61-48de-82dc-9517462e929c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:01.030025 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a517eadd-ca61-48de-82dc-9517462e929c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:01.030690 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a517eadd-ca61-48de-82dc-9517462e929c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:01.165869 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a517eadd-ca61-48de-82dc-9517462e929c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:01.173245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a517eadd-ca61-48de-82dc-9517462e929c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1277 microversion: 2.1 time: 0.156861 Aug 08 14:36:01.173799 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 380/796] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:01 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:01.201514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-aeb0bc6e-d958-478e-b710-5875d8325908 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:01.202117 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-aeb0bc6e-d958-478e-b710-5875d8325908 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:01.209364 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aeb0bc6e-d958-478e-b710-5875d8325908 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:01.209843 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aeb0bc6e-d958-478e-b710-5875d8325908 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:01.210270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aeb0bc6e-d958-478e-b710-5875d8325908 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:01.210955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aeb0bc6e-d958-478e-b710-5875d8325908 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:01.211432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aeb0bc6e-d958-478e-b710-5875d8325908 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:01.211852 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aeb0bc6e-d958-478e-b710-5875d8325908 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:01.273514 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-aeb0bc6e-d958-478e-b710-5875d8325908 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:01.280895 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-aeb0bc6e-d958-478e-b710-5875d8325908 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1293 microversion: 2.1 time: 0.083143 Aug 08 14:36:01.281461 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 417/797] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:01 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:01.308016 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e01de393-97db-4e7e-b947-76c859afa73f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:01.308795 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e01de393-97db-4e7e-b947-76c859afa73f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:01.314758 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e01de393-97db-4e7e-b947-76c859afa73f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:01.315272 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e01de393-97db-4e7e-b947-76c859afa73f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:01.315715 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e01de393-97db-4e7e-b947-76c859afa73f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:01.316416 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e01de393-97db-4e7e-b947-76c859afa73f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:01.317407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e01de393-97db-4e7e-b947-76c859afa73f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:01.317842 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e01de393-97db-4e7e-b947-76c859afa73f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:01.482059 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e01de393-97db-4e7e-b947-76c859afa73f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:01.490939 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e01de393-97db-4e7e-b947-76c859afa73f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.186901 Aug 08 14:36:01.505658 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 381/798] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:01 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:01.579354 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bda8daea-616e-48ef-a9f1-a61520f00f1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:01.579354 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bda8daea-616e-48ef-a9f1-a61520f00f1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:01.589582 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bda8daea-616e-48ef-a9f1-a61520f00f1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:01.590064 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bda8daea-616e-48ef-a9f1-a61520f00f1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:01.590501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bda8daea-616e-48ef-a9f1-a61520f00f1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:01.591240 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bda8daea-616e-48ef-a9f1-a61520f00f1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:01.591692 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bda8daea-616e-48ef-a9f1-a61520f00f1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:01.592119 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bda8daea-616e-48ef-a9f1-a61520f00f1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:01.742644 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-58d44a2b-ef20-485c-ad09-f1b2b5f21ce0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:01.743593 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-58d44a2b-ef20-485c-ad09-f1b2b5f21ce0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:01.751315 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58d44a2b-ef20-485c-ad09-f1b2b5f21ce0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:01.751941 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58d44a2b-ef20-485c-ad09-f1b2b5f21ce0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:01.752460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58d44a2b-ef20-485c-ad09-f1b2b5f21ce0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:01.753421 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58d44a2b-ef20-485c-ad09-f1b2b5f21ce0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:01.754034 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58d44a2b-ef20-485c-ad09-f1b2b5f21ce0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:01.755147 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58d44a2b-ef20-485c-ad09-f1b2b5f21ce0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:01.782126 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bda8daea-616e-48ef-a9f1-a61520f00f1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:01.802441 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bda8daea-616e-48ef-a9f1-a61520f00f1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:01.806504 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bda8daea-616e-48ef-a9f1-a61520f00f1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:01.810466 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bda8daea-616e-48ef-a9f1-a61520f00f1d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1406 microversion: 2.20 time: 0.239055 Aug 08 14:36:01.811782 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 418/799] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:36:01 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:36:01.953414 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-58d44a2b-ef20-485c-ad09-f1b2b5f21ce0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:01.970405 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-58d44a2b-ef20-485c-ad09-f1b2b5f21ce0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1594 microversion: 2.1 time: 0.232319 Aug 08 14:36:01.970553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-75748776-ac38-4502-94ac-34af792f0b50 req-f74a8afc-3c49-4284-8081-0b4169544aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79aaf7b-bbdb-42b5-a337-89102612ff93", "name": "network-vif-plugged", "status": "completed", "tag": "9bfd7cef-c545-4cf2-8212-293910501379"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:01.972064 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 382/800] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:01 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1594 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:01.983488 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-75748776-ac38-4502-94ac-34af792f0b50 req-f74a8afc-3c49-4284-8081-0b4169544aed service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:01.987785 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-75748776-ac38-4502-94ac-34af792f0b50 req-f74a8afc-3c49-4284-8081-0b4169544aed service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:01.988239 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-75748776-ac38-4502-94ac-34af792f0b50 req-f74a8afc-3c49-4284-8081-0b4169544aed service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:02.002772 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-75748776-ac38-4502-94ac-34af792f0b50 req-f74a8afc-3c49-4284-8081-0b4169544aed service nova] Creating event network-vif-plugged:9bfd7cef-c545-4cf2-8212-293910501379 for instance c79aaf7b-bbdb-42b5-a337-89102612ff93 on hv-cinder-85200 Aug 08 14:36:02.009865 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-75748776-ac38-4502-94ac-34af792f0b50 req-f74a8afc-3c49-4284-8081-0b4169544aed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042932 Aug 08 14:36:02.011411 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 419/801] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:36:02.194869 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-54e52d35-97fa-4d6a-8dbf-bbe6a1c8f613 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:02.195680 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-54e52d35-97fa-4d6a-8dbf-bbe6a1c8f613 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:02.203508 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54e52d35-97fa-4d6a-8dbf-bbe6a1c8f613 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:02.204093 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54e52d35-97fa-4d6a-8dbf-bbe6a1c8f613 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:02.204752 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54e52d35-97fa-4d6a-8dbf-bbe6a1c8f613 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:02.205603 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54e52d35-97fa-4d6a-8dbf-bbe6a1c8f613 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:02.206124 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54e52d35-97fa-4d6a-8dbf-bbe6a1c8f613 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:02.206612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54e52d35-97fa-4d6a-8dbf-bbe6a1c8f613 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:02.303035 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-46cd2240-c897-45b7-a1d9-4ae338b1daba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:02.303767 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-46cd2240-c897-45b7-a1d9-4ae338b1daba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:02.312916 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46cd2240-c897-45b7-a1d9-4ae338b1daba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:02.313939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46cd2240-c897-45b7-a1d9-4ae338b1daba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:02.314713 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46cd2240-c897-45b7-a1d9-4ae338b1daba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:02.315930 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46cd2240-c897-45b7-a1d9-4ae338b1daba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:02.317074 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46cd2240-c897-45b7-a1d9-4ae338b1daba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:02.317783 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46cd2240-c897-45b7-a1d9-4ae338b1daba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:02.449447 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-46cd2240-c897-45b7-a1d9-4ae338b1daba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:02.462117 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-46cd2240-c897-45b7-a1d9-4ae338b1daba tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1299 microversion: 2.1 time: 0.163323 Aug 08 14:36:02.463266 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 420/802] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:02 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:02.514015 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-496ab481-b028-4673-a11d-62fb8a912982 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:02.514986 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-496ab481-b028-4673-a11d-62fb8a912982 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:02.525393 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-496ab481-b028-4673-a11d-62fb8a912982 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:02.526209 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-496ab481-b028-4673-a11d-62fb8a912982 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:02.526741 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-496ab481-b028-4673-a11d-62fb8a912982 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:02.527806 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-496ab481-b028-4673-a11d-62fb8a912982 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:02.528499 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-496ab481-b028-4673-a11d-62fb8a912982 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:02.529260 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-496ab481-b028-4673-a11d-62fb8a912982 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:02.544404 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-54e52d35-97fa-4d6a-8dbf-bbe6a1c8f613 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:02.557295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-54e52d35-97fa-4d6a-8dbf-bbe6a1c8f613 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1265 microversion: 2.1 time: 0.365672 Aug 08 14:36:02.558967 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 383/803] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:02 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1265 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:02.774626 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-496ab481-b028-4673-a11d-62fb8a912982 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:02.783610 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-496ab481-b028-4673-a11d-62fb8a912982 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.275373 Aug 08 14:36:02.784270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 421/804] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:02 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:02.838517 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ba4a0d2f-9b03-4c14-b096-d50ad9d9a4f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:02.839452 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ba4a0d2f-9b03-4c14-b096-d50ad9d9a4f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:02.845687 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4a0d2f-9b03-4c14-b096-d50ad9d9a4f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:02.846359 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4a0d2f-9b03-4c14-b096-d50ad9d9a4f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:02.847252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4a0d2f-9b03-4c14-b096-d50ad9d9a4f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:02.848194 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4a0d2f-9b03-4c14-b096-d50ad9d9a4f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:02.848652 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4a0d2f-9b03-4c14-b096-d50ad9d9a4f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:02.849420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba4a0d2f-9b03-4c14-b096-d50ad9d9a4f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:03.086757 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ba4a0d2f-9b03-4c14-b096-d50ad9d9a4f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:03.095218 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ba4a0d2f-9b03-4c14-b096-d50ad9d9a4f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:03.096872 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ba4a0d2f-9b03-4c14-b096-d50ad9d9a4f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:03.098306 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ba4a0d2f-9b03-4c14-b096-d50ad9d9a4f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1406 microversion: 2.20 time: 0.263492 Aug 08 14:36:03.099072 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 384/805] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:36:02 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:36:03.488195 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0f7a4407-3387-4dee-b0d9-9edf97c83f15 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:03.489986 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-0f7a4407-3387-4dee-b0d9-9edf97c83f15 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:03.498150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0f7a4407-3387-4dee-b0d9-9edf97c83f15 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:03.499359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0f7a4407-3387-4dee-b0d9-9edf97c83f15 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:03.499960 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0f7a4407-3387-4dee-b0d9-9edf97c83f15 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:03.500837 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0f7a4407-3387-4dee-b0d9-9edf97c83f15 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:03.501295 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0f7a4407-3387-4dee-b0d9-9edf97c83f15 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:03.501877 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0f7a4407-3387-4dee-b0d9-9edf97c83f15 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:03.580090 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-54d44ad8-567e-4432-88d6-241fef84cd74 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:03.581384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-54d44ad8-567e-4432-88d6-241fef84cd74 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:03.589794 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54d44ad8-567e-4432-88d6-241fef84cd74 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:03.590461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54d44ad8-567e-4432-88d6-241fef84cd74 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:03.591207 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54d44ad8-567e-4432-88d6-241fef84cd74 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:03.592083 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54d44ad8-567e-4432-88d6-241fef84cd74 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:03.592865 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54d44ad8-567e-4432-88d6-241fef84cd74 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:03.593574 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-54d44ad8-567e-4432-88d6-241fef84cd74 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:04.117746 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-54d44ad8-567e-4432-88d6-241fef84cd74 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:04.125517 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-54d44ad8-567e-4432-88d6-241fef84cd74 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1265 microversion: 2.1 time: 0.549332 Aug 08 14:36:04.126121 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 385/806] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:03 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1265 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:04.142555 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-9f088709-2ce5-4f50-b79d-bd4c5ea4ac3c req-46c58462-31e5-4536-9a1e-29af34915285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba51345a-39b0-42ed-b0af-bff1e07fd698", "tag": "7ec70809-83bf-4ac1-8bc8-709bc220f063"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:04.152780 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-9f088709-2ce5-4f50-b79d-bd4c5ea4ac3c req-46c58462-31e5-4536-9a1e-29af34915285 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:04.153256 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-9f088709-2ce5-4f50-b79d-bd4c5ea4ac3c req-46c58462-31e5-4536-9a1e-29af34915285 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:04.153788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-9f088709-2ce5-4f50-b79d-bd4c5ea4ac3c req-46c58462-31e5-4536-9a1e-29af34915285 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:04.165075 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-9f088709-2ce5-4f50-b79d-bd4c5ea4ac3c req-46c58462-31e5-4536-9a1e-29af34915285 service nova] Creating event network-changed:7ec70809-83bf-4ac1-8bc8-709bc220f063 for instance ba51345a-39b0-42ed-b0af-bff1e07fd698 on hv-cinder-85200 Aug 08 14:36:04.170036 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-9f088709-2ce5-4f50-b79d-bd4c5ea4ac3c req-46c58462-31e5-4536-9a1e-29af34915285 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042671 Aug 08 14:36:04.170623 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 386/807] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:04.178025 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-655439b6-646d-429e-8bd1-ab697f8ec7fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:04.178809 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-655439b6-646d-429e-8bd1-ab697f8ec7fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:04.183483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-0f7a4407-3387-4dee-b0d9-9edf97c83f15 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:04.185589 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-655439b6-646d-429e-8bd1-ab697f8ec7fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:04.185589 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-655439b6-646d-429e-8bd1-ab697f8ec7fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:04.186143 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-655439b6-646d-429e-8bd1-ab697f8ec7fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:04.186985 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-655439b6-646d-429e-8bd1-ab697f8ec7fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:04.187550 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-655439b6-646d-429e-8bd1-ab697f8ec7fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:04.188009 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-655439b6-646d-429e-8bd1-ab697f8ec7fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:04.194191 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0f7a4407-3387-4dee-b0d9-9edf97c83f15 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1367 microversion: 2.1 time: 0.712401 Aug 08 14:36:04.194191 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 422/808] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:03 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1367 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:04.198051 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b11d4a22-ff3d-48da-a17a-a283072b5fd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:04.198876 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b11d4a22-ff3d-48da-a17a-a283072b5fd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:04.205299 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b11d4a22-ff3d-48da-a17a-a283072b5fd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:04.206413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b11d4a22-ff3d-48da-a17a-a283072b5fd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:04.206862 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b11d4a22-ff3d-48da-a17a-a283072b5fd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:04.208183 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b11d4a22-ff3d-48da-a17a-a283072b5fd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:04.208629 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b11d4a22-ff3d-48da-a17a-a283072b5fd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:04.209056 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b11d4a22-ff3d-48da-a17a-a283072b5fd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:04.474092 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-655439b6-646d-429e-8bd1-ab697f8ec7fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:04.482264 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-655439b6-646d-429e-8bd1-ab697f8ec7fb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.309205 Aug 08 14:36:04.482838 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 387/809] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:04 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:04.512617 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b11d4a22-ff3d-48da-a17a-a283072b5fd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:04.516162 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=100 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:04.522272 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b11d4a22-ff3d-48da-a17a-a283072b5fd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:04.523893 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b11d4a22-ff3d-48da-a17a-a283072b5fd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:04.525264 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b11d4a22-ff3d-48da-a17a-a283072b5fd2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1406 microversion: 2.20 time: 0.331283 Aug 08 14:36:04.525842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 423/810] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:36:04 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:36:04.788390 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-fc519963-1894-4b13-b180-7e5b8eb7954b req-27f42f56-35b2-4537-9ec6-36c855982007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7117df5-9606-4392-a933-e624f6e97e2e", "tag": "d8539c0a-5ff5-4ee6-883f-9961bff24df3"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:04.805649 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-fc519963-1894-4b13-b180-7e5b8eb7954b req-27f42f56-35b2-4537-9ec6-36c855982007 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:04.806224 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-fc519963-1894-4b13-b180-7e5b8eb7954b req-27f42f56-35b2-4537-9ec6-36c855982007 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:04.806744 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-fc519963-1894-4b13-b180-7e5b8eb7954b req-27f42f56-35b2-4537-9ec6-36c855982007 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:04.823473 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-fc519963-1894-4b13-b180-7e5b8eb7954b req-27f42f56-35b2-4537-9ec6-36c855982007 service nova] Creating event network-changed:d8539c0a-5ff5-4ee6-883f-9961bff24df3 for instance a7117df5-9606-4392-a933-e624f6e97e2e on hv-cinder-85200 Aug 08 14:36:04.828893 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-fc519963-1894-4b13-b180-7e5b8eb7954b req-27f42f56-35b2-4537-9ec6-36c855982007 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048296 Aug 08 14:36:04.829972 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 388/811] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:05.149461 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6b313100-98ec-4d5d-8ced-0fa1a5e33270 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:05.150338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6b313100-98ec-4d5d-8ced-0fa1a5e33270 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:05.157695 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b313100-98ec-4d5d-8ced-0fa1a5e33270 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:05.158410 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b313100-98ec-4d5d-8ced-0fa1a5e33270 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:05.159076 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b313100-98ec-4d5d-8ced-0fa1a5e33270 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:05.159960 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b313100-98ec-4d5d-8ced-0fa1a5e33270 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:05.160616 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b313100-98ec-4d5d-8ced-0fa1a5e33270 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:05.161229 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6b313100-98ec-4d5d-8ced-0fa1a5e33270 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:05.223128 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e747cf11-7eb5-4a20-83ed-16634a09e3bf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:05.225607 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e747cf11-7eb5-4a20-83ed-16634a09e3bf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:05.234191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e747cf11-7eb5-4a20-83ed-16634a09e3bf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:05.234913 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e747cf11-7eb5-4a20-83ed-16634a09e3bf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:05.235545 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e747cf11-7eb5-4a20-83ed-16634a09e3bf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:05.236535 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e747cf11-7eb5-4a20-83ed-16634a09e3bf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:05.237158 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e747cf11-7eb5-4a20-83ed-16634a09e3bf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:05.237887 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e747cf11-7eb5-4a20-83ed-16634a09e3bf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:05.365513 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6b313100-98ec-4d5d-8ced-0fa1a5e33270 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:05.388084 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6b313100-98ec-4d5d-8ced-0fa1a5e33270 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1265 microversion: 2.1 time: 0.242868 Aug 08 14:36:05.389026 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 424/812] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:05 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:05.442973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e747cf11-7eb5-4a20-83ed-16634a09e3bf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:05.454045 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e747cf11-7eb5-4a20-83ed-16634a09e3bf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1367 microversion: 2.1 time: 0.242991 Aug 08 14:36:05.467073 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 389/813] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:05 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:05.505108 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2b57a643-13e4-4bb1-9929-200d9cc40498 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:05.506029 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2b57a643-13e4-4bb1-9929-200d9cc40498 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:05.514120 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b57a643-13e4-4bb1-9929-200d9cc40498 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:05.527902 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b57a643-13e4-4bb1-9929-200d9cc40498 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:05.530146 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b57a643-13e4-4bb1-9929-200d9cc40498 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:05.530948 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b57a643-13e4-4bb1-9929-200d9cc40498 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:05.531462 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b57a643-13e4-4bb1-9929-200d9cc40498 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:05.531893 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b57a643-13e4-4bb1-9929-200d9cc40498 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:05.549467 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8e7fb699-b6df-4e39-a24b-c40e08ee1a91 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:05.550456 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8e7fb699-b6df-4e39-a24b-c40e08ee1a91 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:05.564138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e7fb699-b6df-4e39-a24b-c40e08ee1a91 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:05.565512 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e7fb699-b6df-4e39-a24b-c40e08ee1a91 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:05.566129 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e7fb699-b6df-4e39-a24b-c40e08ee1a91 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:05.567589 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e7fb699-b6df-4e39-a24b-c40e08ee1a91 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:05.568573 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e7fb699-b6df-4e39-a24b-c40e08ee1a91 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:05.569667 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e7fb699-b6df-4e39-a24b-c40e08ee1a91 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:05.823501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2b57a643-13e4-4bb1-9929-200d9cc40498 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:05.832899 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2b57a643-13e4-4bb1-9929-200d9cc40498 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.332771 Aug 08 14:36:05.836574 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8e7fb699-b6df-4e39-a24b-c40e08ee1a91 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:05.867283 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8e7fb699-b6df-4e39-a24b-c40e08ee1a91 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:05.868807 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8e7fb699-b6df-4e39-a24b-c40e08ee1a91 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:05.869976 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8e7fb699-b6df-4e39-a24b-c40e08ee1a91 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1598 microversion: 2.20 time: 0.325379 Aug 08 14:36:05.870533 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 390/815] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:36:05 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1598 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:36:05.870643 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 425/815] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:05 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:05.893066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b2cae409-9995-4e12-bfcb-8f51d707f8de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:05.893859 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b2cae409-9995-4e12-bfcb-8f51d707f8de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:05.900728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2cae409-9995-4e12-bfcb-8f51d707f8de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:05.901222 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2cae409-9995-4e12-bfcb-8f51d707f8de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:05.901670 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2cae409-9995-4e12-bfcb-8f51d707f8de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:05.902385 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2cae409-9995-4e12-bfcb-8f51d707f8de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:05.902847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2cae409-9995-4e12-bfcb-8f51d707f8de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:05.903303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2cae409-9995-4e12-bfcb-8f51d707f8de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:06.005092 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b2cae409-9995-4e12-bfcb-8f51d707f8de tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.116245 Aug 08 14:36:06.006398 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 391/816] 10.222.0.50 () {60 vars in 1316 bytes} [Mon Aug 8 14:36:05 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:36:06.070801 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b17e0d42-62bd-43d1-bfc7-83c9632244f0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1608951979"}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:06.071470 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b17e0d42-62bd-43d1-bfc7-83c9632244f0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:06.077491 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b17e0d42-62bd-43d1-bfc7-83c9632244f0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:06.078047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b17e0d42-62bd-43d1-bfc7-83c9632244f0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:06.078550 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b17e0d42-62bd-43d1-bfc7-83c9632244f0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:06.079342 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b17e0d42-62bd-43d1-bfc7-83c9632244f0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:06.079865 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b17e0d42-62bd-43d1-bfc7-83c9632244f0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:06.080375 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b17e0d42-62bd-43d1-bfc7-83c9632244f0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:06.240070 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.network.security_group_api [None req-b17e0d42-62bd-43d1-bfc7-83c9632244f0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Adding security group 7623e397-3df8-49c5-88c7-50881c1d16b2 to port d8539c0a-5ff5-4ee6-883f-9961bff24df3 Aug 08 14:36:06.408539 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1b05ea5b-2b59-4af9-8d25-76199f7c265d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:06.409638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1b05ea5b-2b59-4af9-8d25-76199f7c265d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:06.416016 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1b05ea5b-2b59-4af9-8d25-76199f7c265d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:06.416502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1b05ea5b-2b59-4af9-8d25-76199f7c265d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:06.416936 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1b05ea5b-2b59-4af9-8d25-76199f7c265d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:06.417695 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1b05ea5b-2b59-4af9-8d25-76199f7c265d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:06.418357 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1b05ea5b-2b59-4af9-8d25-76199f7c265d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:06.418780 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1b05ea5b-2b59-4af9-8d25-76199f7c265d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:06.644456 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1b05ea5b-2b59-4af9-8d25-76199f7c265d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:06.648101 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=100 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:06.657656 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1b05ea5b-2b59-4af9-8d25-76199f7c265d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1265 microversion: 2.1 time: 0.252675 Aug 08 14:36:06.658520 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 392/817] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:06 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:06.664595 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1a97ae6b-bbc7-4138-9c9b-871f51eaf0af tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:06.665611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1a97ae6b-bbc7-4138-9c9b-871f51eaf0af tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:06.672396 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a97ae6b-bbc7-4138-9c9b-871f51eaf0af tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:06.673144 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a97ae6b-bbc7-4138-9c9b-871f51eaf0af tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:06.673844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a97ae6b-bbc7-4138-9c9b-871f51eaf0af tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:06.675418 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a97ae6b-bbc7-4138-9c9b-871f51eaf0af tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:06.676298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a97ae6b-bbc7-4138-9c9b-871f51eaf0af tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:06.676899 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a97ae6b-bbc7-4138-9c9b-871f51eaf0af tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:06.695587 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=6 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:06.720156 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=22 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:06.722982 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b17e0d42-62bd-43d1-bfc7-83c9632244f0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "POST /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/action" status: 202 len: 0 microversion: 2.1 time: 0.656318 Aug 08 14:36:06.723631 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 426/818] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 14:36:06 2022] POST /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/action => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:36:06.732680 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-61ba0d81-7c73-49dd-b606-48c95ee1e5ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:06.733531 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-61ba0d81-7c73-49dd-b606-48c95ee1e5ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:06.741360 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-61ba0d81-7c73-49dd-b606-48c95ee1e5ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:06.741867 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-61ba0d81-7c73-49dd-b606-48c95ee1e5ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:06.742309 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-61ba0d81-7c73-49dd-b606-48c95ee1e5ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:06.743039 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-61ba0d81-7c73-49dd-b606-48c95ee1e5ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:06.743900 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-61ba0d81-7c73-49dd-b606-48c95ee1e5ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:06.744533 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-61ba0d81-7c73-49dd-b606-48c95ee1e5ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:06.844609 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=10 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:07.026516 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1a97ae6b-bbc7-4138-9c9b-871f51eaf0af tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:07.030736 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-61ba0d81-7c73-49dd-b606-48c95ee1e5ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:07.039589 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1a97ae6b-bbc7-4138-9c9b-871f51eaf0af tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1367 microversion: 2.1 time: 0.379424 Aug 08 14:36:07.040403 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 393/819] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:06 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:07.045145 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-205ecb1c-4354-421b-bdc6-dd1a546b7083 req-14bc8948-9c93-4bd6-a3e6-60902227c5bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7117df5-9606-4392-a933-e624f6e97e2e", "tag": "d8539c0a-5ff5-4ee6-883f-9961bff24df3"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:07.055833 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-205ecb1c-4354-421b-bdc6-dd1a546b7083 req-14bc8948-9c93-4bd6-a3e6-60902227c5bb service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:07.056583 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-205ecb1c-4354-421b-bdc6-dd1a546b7083 req-14bc8948-9c93-4bd6-a3e6-60902227c5bb service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:07.056707 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-61ba0d81-7c73-49dd-b606-48c95ee1e5ba tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1641 microversion: 2.1 time: 0.328399 Aug 08 14:36:07.057282 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-205ecb1c-4354-421b-bdc6-dd1a546b7083 req-14bc8948-9c93-4bd6-a3e6-60902227c5bb service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:07.071360 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 427/820] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:06 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1641 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:07.071360 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c97ae55b-0771-4b8d-a377-fa670d52081c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:07.071360 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c97ae55b-0771-4b8d-a377-fa670d52081c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:07.071360 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c97ae55b-0771-4b8d-a377-fa670d52081c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:07.071744 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c97ae55b-0771-4b8d-a377-fa670d52081c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:07.071855 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c97ae55b-0771-4b8d-a377-fa670d52081c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:07.072641 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c97ae55b-0771-4b8d-a377-fa670d52081c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:07.073100 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c97ae55b-0771-4b8d-a377-fa670d52081c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:07.073621 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c97ae55b-0771-4b8d-a377-fa670d52081c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:07.086485 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-205ecb1c-4354-421b-bdc6-dd1a546b7083 req-14bc8948-9c93-4bd6-a3e6-60902227c5bb service nova] Creating event network-changed:d8539c0a-5ff5-4ee6-883f-9961bff24df3 for instance a7117df5-9606-4392-a933-e624f6e97e2e on hv-cinder-85200 Aug 08 14:36:07.092789 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-205ecb1c-4354-421b-bdc6-dd1a546b7083 req-14bc8948-9c93-4bd6-a3e6-60902227c5bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050788 Aug 08 14:36:07.097528 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 394/821] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:07.242599 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c97ae55b-0771-4b8d-a377-fa670d52081c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:07.256572 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c97ae55b-0771-4b8d-a377-fa670d52081c tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.197634 Aug 08 14:36:07.257174 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 428/822] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:07 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:07.686377 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f72df5c6-4cb9-4140-98f3-c703a71a5397 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:07.687073 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f72df5c6-4cb9-4140-98f3-c703a71a5397 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:07.693175 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f72df5c6-4cb9-4140-98f3-c703a71a5397 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:07.693653 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f72df5c6-4cb9-4140-98f3-c703a71a5397 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:07.694083 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f72df5c6-4cb9-4140-98f3-c703a71a5397 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:07.694806 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f72df5c6-4cb9-4140-98f3-c703a71a5397 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:07.695279 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f72df5c6-4cb9-4140-98f3-c703a71a5397 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:07.695700 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f72df5c6-4cb9-4140-98f3-c703a71a5397 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:07.852824 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f72df5c6-4cb9-4140-98f3-c703a71a5397 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:07.865578 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f72df5c6-4cb9-4140-98f3-c703a71a5397 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1265 microversion: 2.1 time: 0.181699 Aug 08 14:36:07.871124 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 395/823] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:07 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:07.983990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-39d390a1-fb2c-490e-9ca1-4a80d189fa53 req-cac98190-e43c-4354-a814-4d32411a5f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79aaf7b-bbdb-42b5-a337-89102612ff93", "tag": "9bfd7cef-c545-4cf2-8212-293910501379"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:07.992444 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:07.995043 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-39d390a1-fb2c-490e-9ca1-4a80d189fa53 req-cac98190-e43c-4354-a814-4d32411a5f22 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:07.995710 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-39d390a1-fb2c-490e-9ca1-4a80d189fa53 req-cac98190-e43c-4354-a814-4d32411a5f22 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:07.996210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-39d390a1-fb2c-490e-9ca1-4a80d189fa53 req-cac98190-e43c-4354-a814-4d32411a5f22 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:08.011998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-39d390a1-fb2c-490e-9ca1-4a80d189fa53 req-cac98190-e43c-4354-a814-4d32411a5f22 service nova] Creating event network-changed:9bfd7cef-c545-4cf2-8212-293910501379 for instance c79aaf7b-bbdb-42b5-a337-89102612ff93 on hv-cinder-85200 Aug 08 14:36:08.017181 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-39d390a1-fb2c-490e-9ca1-4a80d189fa53 req-cac98190-e43c-4354-a814-4d32411a5f22 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036816 Aug 08 14:36:08.017769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 429/824] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:08.062808 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bff2342f-3ed1-4adf-ba6c-b75d66e2ab9a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:08.063705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bff2342f-3ed1-4adf-ba6c-b75d66e2ab9a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:08.070779 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bff2342f-3ed1-4adf-ba6c-b75d66e2ab9a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:08.071496 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bff2342f-3ed1-4adf-ba6c-b75d66e2ab9a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:08.071997 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bff2342f-3ed1-4adf-ba6c-b75d66e2ab9a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:08.072767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bff2342f-3ed1-4adf-ba6c-b75d66e2ab9a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:08.073338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bff2342f-3ed1-4adf-ba6c-b75d66e2ab9a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:08.073861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bff2342f-3ed1-4adf-ba6c-b75d66e2ab9a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:08.212980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bff2342f-3ed1-4adf-ba6c-b75d66e2ab9a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:08.220401 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bff2342f-3ed1-4adf-ba6c-b75d66e2ab9a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1367 microversion: 2.1 time: 0.162716 Aug 08 14:36:08.220985 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 396/825] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:08 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:08.280192 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-cd4cf31a-fae6-4231-9bbe-f561588224d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:08.280192 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-cd4cf31a-fae6-4231-9bbe-f561588224d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:08.288093 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cd4cf31a-fae6-4231-9bbe-f561588224d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:08.288560 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cd4cf31a-fae6-4231-9bbe-f561588224d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:08.289244 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cd4cf31a-fae6-4231-9bbe-f561588224d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:08.289955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cd4cf31a-fae6-4231-9bbe-f561588224d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:08.290486 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cd4cf31a-fae6-4231-9bbe-f561588224d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:08.290854 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cd4cf31a-fae6-4231-9bbe-f561588224d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:08.587292 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-cd4cf31a-fae6-4231-9bbe-f561588224d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:08.596400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-cd4cf31a-fae6-4231-9bbe-f561588224d4 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.322008 Aug 08 14:36:08.607349 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 430/826] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:08 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:08.886095 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-cc0e8998-b9a9-44ae-8b97-56f45f23f7b5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:08.886808 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-cc0e8998-b9a9-44ae-8b97-56f45f23f7b5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:08.893478 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cc0e8998-b9a9-44ae-8b97-56f45f23f7b5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:08.893966 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cc0e8998-b9a9-44ae-8b97-56f45f23f7b5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:08.894419 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cc0e8998-b9a9-44ae-8b97-56f45f23f7b5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:08.895194 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cc0e8998-b9a9-44ae-8b97-56f45f23f7b5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:08.895591 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cc0e8998-b9a9-44ae-8b97-56f45f23f7b5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:08.896018 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cc0e8998-b9a9-44ae-8b97-56f45f23f7b5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:09.036380 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-cc0e8998-b9a9-44ae-8b97-56f45f23f7b5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:09.044246 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-cc0e8998-b9a9-44ae-8b97-56f45f23f7b5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1265 microversion: 2.1 time: 0.162150 Aug 08 14:36:09.044824 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 397/827] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:08 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:09.241819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bfb56735-8c03-421a-abcf-053f6d21a796 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:09.242521 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bfb56735-8c03-421a-abcf-053f6d21a796 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:09.249149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bfb56735-8c03-421a-abcf-053f6d21a796 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:09.249638 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bfb56735-8c03-421a-abcf-053f6d21a796 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:09.250078 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bfb56735-8c03-421a-abcf-053f6d21a796 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:09.250777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bfb56735-8c03-421a-abcf-053f6d21a796 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:09.251257 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bfb56735-8c03-421a-abcf-053f6d21a796 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:09.251683 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bfb56735-8c03-421a-abcf-053f6d21a796 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:09.380707 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bfb56735-8c03-421a-abcf-053f6d21a796 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:09.387950 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bfb56735-8c03-421a-abcf-053f6d21a796 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1367 microversion: 2.1 time: 0.150533 Aug 08 14:36:09.388509 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 431/828] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:09 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:09.617714 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-efc1a426-bfc0-4ad7-b714-c5b30158e69a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:09.618302 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-efc1a426-bfc0-4ad7-b714-c5b30158e69a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:09.624218 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-efc1a426-bfc0-4ad7-b714-c5b30158e69a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:09.624694 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-efc1a426-bfc0-4ad7-b714-c5b30158e69a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:09.625127 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-efc1a426-bfc0-4ad7-b714-c5b30158e69a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:09.625809 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-efc1a426-bfc0-4ad7-b714-c5b30158e69a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:09.626295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-efc1a426-bfc0-4ad7-b714-c5b30158e69a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:09.626719 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-efc1a426-bfc0-4ad7-b714-c5b30158e69a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:09.859617 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-efc1a426-bfc0-4ad7-b714-c5b30158e69a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:09.871460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-efc1a426-bfc0-4ad7-b714-c5b30158e69a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.257483 Aug 08 14:36:09.872380 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 398/829] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:09 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:09.904812 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-f5e8bafc-391a-44bf-bd83-6b3121453492 req-a8de3f94-56ae-44bc-9bbe-2ae07348c6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba51345a-39b0-42ed-b0af-bff1e07fd698", "name": "network-vif-plugged", "status": "completed", "tag": "7ec70809-83bf-4ac1-8bc8-709bc220f063"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:09.920637 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-f5e8bafc-391a-44bf-bd83-6b3121453492 req-a8de3f94-56ae-44bc-9bbe-2ae07348c6b6 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:09.921213 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-f5e8bafc-391a-44bf-bd83-6b3121453492 req-a8de3f94-56ae-44bc-9bbe-2ae07348c6b6 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:09.921868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-f5e8bafc-391a-44bf-bd83-6b3121453492 req-a8de3f94-56ae-44bc-9bbe-2ae07348c6b6 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:09.937617 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-f5e8bafc-391a-44bf-bd83-6b3121453492 req-a8de3f94-56ae-44bc-9bbe-2ae07348c6b6 service nova] Creating event network-vif-plugged:7ec70809-83bf-4ac1-8bc8-709bc220f063 for instance ba51345a-39b0-42ed-b0af-bff1e07fd698 on hv-cinder-85200 Aug 08 14:36:09.944473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-f5e8bafc-391a-44bf-bd83-6b3121453492 req-a8de3f94-56ae-44bc-9bbe-2ae07348c6b6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043387 Aug 08 14:36:09.945231 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 432/830] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:10.064830 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5ae3ae27-f404-442a-966b-9eb698126609 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:10.065440 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5ae3ae27-f404-442a-966b-9eb698126609 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:10.072508 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ae3ae27-f404-442a-966b-9eb698126609 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:10.073035 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ae3ae27-f404-442a-966b-9eb698126609 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:10.073467 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ae3ae27-f404-442a-966b-9eb698126609 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:10.074153 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ae3ae27-f404-442a-966b-9eb698126609 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:10.074599 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ae3ae27-f404-442a-966b-9eb698126609 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:10.075020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ae3ae27-f404-442a-966b-9eb698126609 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:10.210108 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5ae3ae27-f404-442a-966b-9eb698126609 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:10.223645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5ae3ae27-f404-442a-966b-9eb698126609 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1265 microversion: 2.1 time: 0.162791 Aug 08 14:36:10.235855 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 399/831] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:10 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:10.410471 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f9758040-5a9c-424c-9bd2-321a84d96fac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:10.411234 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f9758040-5a9c-424c-9bd2-321a84d96fac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:10.418781 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f9758040-5a9c-424c-9bd2-321a84d96fac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:10.419315 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f9758040-5a9c-424c-9bd2-321a84d96fac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:10.419994 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f9758040-5a9c-424c-9bd2-321a84d96fac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:10.420757 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f9758040-5a9c-424c-9bd2-321a84d96fac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:10.421235 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f9758040-5a9c-424c-9bd2-321a84d96fac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:10.421665 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f9758040-5a9c-424c-9bd2-321a84d96fac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:10.753209 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f9758040-5a9c-424c-9bd2-321a84d96fac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:10.761213 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f9758040-5a9c-424c-9bd2-321a84d96fac tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1367 microversion: 2.1 time: 0.355862 Aug 08 14:36:10.768178 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 433/832] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:10 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1367 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:10.892929 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e793432b-9565-4f73-a3ab-8a5b92d6d459 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:10.893641 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e793432b-9565-4f73-a3ab-8a5b92d6d459 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:10.899922 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e793432b-9565-4f73-a3ab-8a5b92d6d459 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:10.900406 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e793432b-9565-4f73-a3ab-8a5b92d6d459 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:10.900870 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e793432b-9565-4f73-a3ab-8a5b92d6d459 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:10.901562 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e793432b-9565-4f73-a3ab-8a5b92d6d459 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:10.902011 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e793432b-9565-4f73-a3ab-8a5b92d6d459 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:10.902431 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e793432b-9565-4f73-a3ab-8a5b92d6d459 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:11.037105 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e793432b-9565-4f73-a3ab-8a5b92d6d459 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:11.045422 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e793432b-9565-4f73-a3ab-8a5b92d6d459 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1737 microversion: 2.1 time: 0.156521 Aug 08 14:36:11.045989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 400/833] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:10 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:11.243954 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3a94aad0-5eb6-40f3-9414-4cf699835cc6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:11.244831 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3a94aad0-5eb6-40f3-9414-4cf699835cc6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:11.251068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a94aad0-5eb6-40f3-9414-4cf699835cc6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:11.251595 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a94aad0-5eb6-40f3-9414-4cf699835cc6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:11.252037 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a94aad0-5eb6-40f3-9414-4cf699835cc6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:11.252733 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a94aad0-5eb6-40f3-9414-4cf699835cc6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:11.253186 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a94aad0-5eb6-40f3-9414-4cf699835cc6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:11.254652 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a94aad0-5eb6-40f3-9414-4cf699835cc6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:11.393698 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3a94aad0-5eb6-40f3-9414-4cf699835cc6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:11.401285 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3a94aad0-5eb6-40f3-9414-4cf699835cc6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1265 microversion: 2.1 time: 0.161137 Aug 08 14:36:11.401858 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 434/834] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:11 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:11.782248 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d219a62e-ef4c-4fba-9cb0-45a629444f90 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:11.783246 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d219a62e-ef4c-4fba-9cb0-45a629444f90 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:11.791066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d219a62e-ef4c-4fba-9cb0-45a629444f90 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:11.791973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d219a62e-ef4c-4fba-9cb0-45a629444f90 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:11.792420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d219a62e-ef4c-4fba-9cb0-45a629444f90 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:11.793202 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d219a62e-ef4c-4fba-9cb0-45a629444f90 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:11.793661 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d219a62e-ef4c-4fba-9cb0-45a629444f90 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:11.794086 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d219a62e-ef4c-4fba-9cb0-45a629444f90 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:11.978485 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d219a62e-ef4c-4fba-9cb0-45a629444f90 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:11.986481 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d219a62e-ef4c-4fba-9cb0-45a629444f90 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1367 microversion: 2.1 time: 0.208302 Aug 08 14:36:11.987051 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 401/835] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:11 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:12.066317 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f67035c3-98be-4f51-aada-8295251980c9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:12.066872 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f67035c3-98be-4f51-aada-8295251980c9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:12.073752 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f67035c3-98be-4f51-aada-8295251980c9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:12.074303 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f67035c3-98be-4f51-aada-8295251980c9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:12.074751 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f67035c3-98be-4f51-aada-8295251980c9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:12.075500 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f67035c3-98be-4f51-aada-8295251980c9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:12.075961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f67035c3-98be-4f51-aada-8295251980c9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:12.076391 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f67035c3-98be-4f51-aada-8295251980c9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:12.209988 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f67035c3-98be-4f51-aada-8295251980c9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:12.217958 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f67035c3-98be-4f51-aada-8295251980c9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1717 microversion: 2.1 time: 0.155602 Aug 08 14:36:12.218525 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 435/836] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:12 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:12.327892 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-be0d013b-1d2c-4949-b119-35a3e3b3fb28 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:12.328684 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-be0d013b-1d2c-4949-b119-35a3e3b3fb28 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:12.335498 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be0d013b-1d2c-4949-b119-35a3e3b3fb28 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:12.335978 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be0d013b-1d2c-4949-b119-35a3e3b3fb28 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:12.336409 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be0d013b-1d2c-4949-b119-35a3e3b3fb28 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:12.337108 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be0d013b-1d2c-4949-b119-35a3e3b3fb28 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:12.337675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be0d013b-1d2c-4949-b119-35a3e3b3fb28 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:12.338102 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be0d013b-1d2c-4949-b119-35a3e3b3fb28 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:12.422453 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b6dce6a8-cc4d-4e5d-83bb-81b8affeff90 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:12.423375 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b6dce6a8-cc4d-4e5d-83bb-81b8affeff90 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:12.428040 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-be0d013b-1d2c-4949-b119-35a3e3b3fb28 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] HTTP exception thrown: Cannot 'detach_volume' instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 while it is in vm_state rescued Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-be0d013b-1d2c-4949-b119-35a3e3b3fb28 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Request method failure captured: Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: DELETE /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments/37786a21-790d-4654-8097-4b348551cb66 HTTP/1.1 Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R57J81LntT0wnBLoq0gsHuTcdb_gHa2boWqNwcHJNT7GzMY0xQaN4u9gbPeQMkc14SBA7jeP_d07iW79RHlaNziPk2GWGa1BYt-GMeY3VrGnZvm8TtxiX0dmqfpjGqGooMq0e11KFxasfjzOL609Nmftln0YBM8XLy3f2h8GasueEo Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 6ecb83fbcae94dca82331ab87f028878 Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:36:12.429767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:36:12.431168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6ecb83fbcae94dca82331ab87f028878"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6ecb83fbcae94dca82331ab87f028878", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ecb83fbcae94dca82331ab87f028878"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ecb83fbcae94dca82331ab87f028878"}]}] Aug 08 14:36:12.431168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:36:12.431168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 6ecb83fbcae94dca82331ab87f028878 Aug 08 14:36:12.431168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:36:12.431168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-ServerRescueNegativeTestJSON-1730375856-project Aug 08 14:36:12.431168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:36:12.431168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:36:12.431168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 7d373dfa8c474ade92e94dc73dd9926f Aug 08 14:36:12.431168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1730375856-project Aug 08 14:36:12.431168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:36:12.431168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Cannot 'detach_volume' instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 while it is in vm_state rescued Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'server_id': '1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8', 'id': '37786a21-790d-4654-8097-4b348551cb66'} Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:36:12.435438 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 while it is in vm_state rescued Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 while it is in vm_state rescued Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:36:12.436749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-be0d013b-1d2c-4949-b119-35a3e3b3fb28 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Returning 409 to user: Cannot 'detach_volume' instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 while it is in vm_state rescued {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:36:12.439013 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-be0d013b-1d2c-4949-b119-35a3e3b3fb28 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments/37786a21-790d-4654-8097-4b348551cb66" status: 409 len: 152 microversion: 2.1 time: 0.107333 Aug 08 14:36:12.439013 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 402/837] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 14:36:12 2022] DELETE /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments/37786a21-790d-4654-8097-4b348551cb66 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 08 14:36:12.439331 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b6dce6a8-cc4d-4e5d-83bb-81b8affeff90 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:12.439331 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b6dce6a8-cc4d-4e5d-83bb-81b8affeff90 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:12.439331 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b6dce6a8-cc4d-4e5d-83bb-81b8affeff90 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:12.439331 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b6dce6a8-cc4d-4e5d-83bb-81b8affeff90 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:12.439937 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b6dce6a8-cc4d-4e5d-83bb-81b8affeff90 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:12.439937 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b6dce6a8-cc4d-4e5d-83bb-81b8affeff90 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:12.441399 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-aa9f139c-7aec-472b-b439-2ff2dfce5c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:12.441399 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-aa9f139c-7aec-472b-b439-2ff2dfce5c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:12.448949 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa9f139c-7aec-472b-b439-2ff2dfce5c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:12.449432 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa9f139c-7aec-472b-b439-2ff2dfce5c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:12.450308 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa9f139c-7aec-472b-b439-2ff2dfce5c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:12.451022 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa9f139c-7aec-472b-b439-2ff2dfce5c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:12.451950 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa9f139c-7aec-472b-b439-2ff2dfce5c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:12.451950 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa9f139c-7aec-472b-b439-2ff2dfce5c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:12.535889 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-aa9f139c-7aec-472b-b439-2ff2dfce5c52 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "POST /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/action" status: 202 len: 0 microversion: 2.1 time: 0.097948 Aug 08 14:36:12.540555 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 403/838] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 14:36:12 2022] POST /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:36:12.546283 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-64adaf91-c38a-44a0-a017-59453b62ab20 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:12.547016 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-64adaf91-c38a-44a0-a017-59453b62ab20 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:12.556375 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64adaf91-c38a-44a0-a017-59453b62ab20 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:12.557192 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64adaf91-c38a-44a0-a017-59453b62ab20 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:12.557799 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64adaf91-c38a-44a0-a017-59453b62ab20 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:12.558972 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64adaf91-c38a-44a0-a017-59453b62ab20 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:12.559553 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64adaf91-c38a-44a0-a017-59453b62ab20 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:12.559982 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64adaf91-c38a-44a0-a017-59453b62ab20 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:12.586483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b6dce6a8-cc4d-4e5d-83bb-81b8affeff90 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:12.593988 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b6dce6a8-cc4d-4e5d-83bb-81b8affeff90 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1265 microversion: 2.1 time: 0.176082 Aug 08 14:36:12.601271 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 436/839] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:12 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:12.705530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-64adaf91-c38a-44a0-a017-59453b62ab20 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:12.713506 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-64adaf91-c38a-44a0-a017-59453b62ab20 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1725 microversion: 2.1 time: 0.171571 Aug 08 14:36:12.714236 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 404/840] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:12 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:13.007393 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-51e3601f-4bc9-435b-a5fd-222b5396f336 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:13.008052 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-51e3601f-4bc9-435b-a5fd-222b5396f336 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:13.013933 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-51e3601f-4bc9-435b-a5fd-222b5396f336 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:13.014410 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-51e3601f-4bc9-435b-a5fd-222b5396f336 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:13.014842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-51e3601f-4bc9-435b-a5fd-222b5396f336 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:13.015547 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-51e3601f-4bc9-435b-a5fd-222b5396f336 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:13.015999 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-51e3601f-4bc9-435b-a5fd-222b5396f336 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:13.016419 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-51e3601f-4bc9-435b-a5fd-222b5396f336 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:13.145731 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-51e3601f-4bc9-435b-a5fd-222b5396f336 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:13.153505 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-51e3601f-4bc9-435b-a5fd-222b5396f336 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1367 microversion: 2.1 time: 0.149997 Aug 08 14:36:13.154070 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 437/841] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:13 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:13.614956 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-57e836ca-f0d2-482e-b3a6-01c66cd19368 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:13.615551 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-57e836ca-f0d2-482e-b3a6-01c66cd19368 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:13.622323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-57e836ca-f0d2-482e-b3a6-01c66cd19368 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:13.622814 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-57e836ca-f0d2-482e-b3a6-01c66cd19368 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:13.623283 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-57e836ca-f0d2-482e-b3a6-01c66cd19368 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:13.623992 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-57e836ca-f0d2-482e-b3a6-01c66cd19368 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:13.624446 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-57e836ca-f0d2-482e-b3a6-01c66cd19368 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:13.624870 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-57e836ca-f0d2-482e-b3a6-01c66cd19368 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:13.735139 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-920f779d-158e-44f1-be62-70b75f813f74 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:13.735752 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-920f779d-158e-44f1-be62-70b75f813f74 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:13.756475 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-920f779d-158e-44f1-be62-70b75f813f74 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:13.757937 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-920f779d-158e-44f1-be62-70b75f813f74 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:13.758640 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-920f779d-158e-44f1-be62-70b75f813f74 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:13.759799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-920f779d-158e-44f1-be62-70b75f813f74 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:13.761209 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-920f779d-158e-44f1-be62-70b75f813f74 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:13.763393 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-920f779d-158e-44f1-be62-70b75f813f74 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:13.769661 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-57e836ca-f0d2-482e-b3a6-01c66cd19368 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:13.777826 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-57e836ca-f0d2-482e-b3a6-01c66cd19368 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1265 microversion: 2.1 time: 0.167340 Aug 08 14:36:13.778418 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 405/842] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:13 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:13.914390 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-920f779d-158e-44f1-be62-70b75f813f74 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:13.927598 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-920f779d-158e-44f1-be62-70b75f813f74 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1725 microversion: 2.1 time: 0.196151 Aug 08 14:36:13.930079 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 438/843] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:13 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:13.933886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-ee48a1f7-70e8-4172-8ff3-6bafb24dea1f req-974d1ab6-2b12-4e95-a480-5f4f909f6954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb38e896-d3ab-4655-bcec-eef6e42c4de4", "name": "network-vif-plugged", "status": "completed", "tag": "a2298513-6cdb-40b2-88dd-cf9f7ad6d82e"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:13.949704 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-ee48a1f7-70e8-4172-8ff3-6bafb24dea1f req-974d1ab6-2b12-4e95-a480-5f4f909f6954 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:13.950287 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-ee48a1f7-70e8-4172-8ff3-6bafb24dea1f req-974d1ab6-2b12-4e95-a480-5f4f909f6954 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:13.950818 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-ee48a1f7-70e8-4172-8ff3-6bafb24dea1f req-974d1ab6-2b12-4e95-a480-5f4f909f6954 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:13.964059 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-ee48a1f7-70e8-4172-8ff3-6bafb24dea1f req-974d1ab6-2b12-4e95-a480-5f4f909f6954 service nova] Creating event network-vif-plugged:a2298513-6cdb-40b2-88dd-cf9f7ad6d82e for instance bb38e896-d3ab-4655-bcec-eef6e42c4de4 on hv-cinder-85200 Aug 08 14:36:13.973100 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-ee48a1f7-70e8-4172-8ff3-6bafb24dea1f req-974d1ab6-2b12-4e95-a480-5f4f909f6954 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047183 Aug 08 14:36:13.974455 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 406/844] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:14.173992 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8ee33505-7e71-43e7-adcc-d480bcb0473e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:14.174610 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8ee33505-7e71-43e7-adcc-d480bcb0473e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:14.182093 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ee33505-7e71-43e7-adcc-d480bcb0473e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:14.182577 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ee33505-7e71-43e7-adcc-d480bcb0473e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:14.183019 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ee33505-7e71-43e7-adcc-d480bcb0473e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:14.183761 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ee33505-7e71-43e7-adcc-d480bcb0473e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:14.184212 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ee33505-7e71-43e7-adcc-d480bcb0473e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:14.184634 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ee33505-7e71-43e7-adcc-d480bcb0473e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:14.320475 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-8ee33505-7e71-43e7-adcc-d480bcb0473e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:14.328254 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8ee33505-7e71-43e7-adcc-d480bcb0473e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1557 microversion: 2.1 time: 0.158112 Aug 08 14:36:14.328904 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 439/845] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:14 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:14.350988 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c594eeb4-0dab-4309-a0b1-5754db9e5ae7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:14.351570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c594eeb4-0dab-4309-a0b1-5754db9e5ae7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:14.357790 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c594eeb4-0dab-4309-a0b1-5754db9e5ae7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:14.358313 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c594eeb4-0dab-4309-a0b1-5754db9e5ae7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:14.358742 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c594eeb4-0dab-4309-a0b1-5754db9e5ae7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:14.359450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c594eeb4-0dab-4309-a0b1-5754db9e5ae7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:14.359908 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c594eeb4-0dab-4309-a0b1-5754db9e5ae7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:14.360318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c594eeb4-0dab-4309-a0b1-5754db9e5ae7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:14.437279 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c594eeb4-0dab-4309-a0b1-5754db9e5ae7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091172 Aug 08 14:36:14.437869 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 407/846] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 14:36:14 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:14.798824 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-187f7f96-b3c2-4223-97ff-2610fe8f6d5b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:14.799261 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-187f7f96-b3c2-4223-97ff-2610fe8f6d5b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:14.805359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-187f7f96-b3c2-4223-97ff-2610fe8f6d5b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:14.805863 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-187f7f96-b3c2-4223-97ff-2610fe8f6d5b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:14.806278 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-187f7f96-b3c2-4223-97ff-2610fe8f6d5b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:14.806978 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-187f7f96-b3c2-4223-97ff-2610fe8f6d5b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:14.807455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-187f7f96-b3c2-4223-97ff-2610fe8f6d5b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:14.807872 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-187f7f96-b3c2-4223-97ff-2610fe8f6d5b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:14.949071 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1c56ab7b-324a-4f95-94eb-8bb2fd56cca1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:14.949743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1c56ab7b-324a-4f95-94eb-8bb2fd56cca1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:14.955844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c56ab7b-324a-4f95-94eb-8bb2fd56cca1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:14.956414 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c56ab7b-324a-4f95-94eb-8bb2fd56cca1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:14.956953 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c56ab7b-324a-4f95-94eb-8bb2fd56cca1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:14.958340 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c56ab7b-324a-4f95-94eb-8bb2fd56cca1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:14.958820 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c56ab7b-324a-4f95-94eb-8bb2fd56cca1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:14.959368 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c56ab7b-324a-4f95-94eb-8bb2fd56cca1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:15.091056 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-187f7f96-b3c2-4223-97ff-2610fe8f6d5b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:15.098738 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-187f7f96-b3c2-4223-97ff-2610fe8f6d5b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1265 microversion: 2.1 time: 0.304246 Aug 08 14:36:15.099576 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 440/847] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:14 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1265 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:15.186979 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1c56ab7b-324a-4f95-94eb-8bb2fd56cca1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:15.195614 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1c56ab7b-324a-4f95-94eb-8bb2fd56cca1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1725 microversion: 2.1 time: 0.251020 Aug 08 14:36:15.196418 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 408/848] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:14 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:15.531454 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-07136a18-d1be-41e5-9760-a8c1ba6323b8 req-d0b2aef8-d1f7-4971-8a5b-f364912d6cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba51345a-39b0-42ed-b0af-bff1e07fd698", "tag": "7ec70809-83bf-4ac1-8bc8-709bc220f063"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:15.542518 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-07136a18-d1be-41e5-9760-a8c1ba6323b8 req-d0b2aef8-d1f7-4971-8a5b-f364912d6cea service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:15.543003 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-07136a18-d1be-41e5-9760-a8c1ba6323b8 req-d0b2aef8-d1f7-4971-8a5b-f364912d6cea service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:15.543469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-07136a18-d1be-41e5-9760-a8c1ba6323b8 req-d0b2aef8-d1f7-4971-8a5b-f364912d6cea service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:15.557582 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-07136a18-d1be-41e5-9760-a8c1ba6323b8 req-d0b2aef8-d1f7-4971-8a5b-f364912d6cea service nova] Creating event network-changed:7ec70809-83bf-4ac1-8bc8-709bc220f063 for instance ba51345a-39b0-42ed-b0af-bff1e07fd698 on hv-cinder-85200 Aug 08 14:36:15.562650 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-07136a18-d1be-41e5-9760-a8c1ba6323b8 req-d0b2aef8-d1f7-4971-8a5b-f364912d6cea service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034845 Aug 08 14:36:15.563302 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 441/849] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:16.119053 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-446e3649-c299-421d-ba3f-aa21727c885a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:16.120439 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-446e3649-c299-421d-ba3f-aa21727c885a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:16.123401 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:16.129252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-446e3649-c299-421d-ba3f-aa21727c885a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:16.129834 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-446e3649-c299-421d-ba3f-aa21727c885a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:16.130346 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-446e3649-c299-421d-ba3f-aa21727c885a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:16.131149 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-446e3649-c299-421d-ba3f-aa21727c885a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:16.131822 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-446e3649-c299-421d-ba3f-aa21727c885a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:16.132341 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-446e3649-c299-421d-ba3f-aa21727c885a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:16.216975 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9523b70e-dbb9-4242-b06a-501074baecb1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:16.217761 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9523b70e-dbb9-4242-b06a-501074baecb1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:16.225169 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9523b70e-dbb9-4242-b06a-501074baecb1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:16.226026 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9523b70e-dbb9-4242-b06a-501074baecb1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:16.226480 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9523b70e-dbb9-4242-b06a-501074baecb1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:16.227666 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9523b70e-dbb9-4242-b06a-501074baecb1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:16.227666 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9523b70e-dbb9-4242-b06a-501074baecb1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:16.228084 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9523b70e-dbb9-4242-b06a-501074baecb1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:16.282479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-446e3649-c299-421d-ba3f-aa21727c885a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:16.294755 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-446e3649-c299-421d-ba3f-aa21727c885a tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1265 microversion: 2.1 time: 0.179556 Aug 08 14:36:16.302664 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 409/850] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:16 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:16.382926 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9523b70e-dbb9-4242-b06a-501074baecb1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:16.386476 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=100 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:16.392025 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9523b70e-dbb9-4242-b06a-501074baecb1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1725 microversion: 2.1 time: 0.179608 Aug 08 14:36:16.392584 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 442/851] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:16 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:17.316120 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-68357f86-bd7b-42ea-b34e-56648d998f55 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:17.316678 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-68357f86-bd7b-42ea-b34e-56648d998f55 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:17.323001 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-68357f86-bd7b-42ea-b34e-56648d998f55 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:17.323524 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-68357f86-bd7b-42ea-b34e-56648d998f55 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:17.323965 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-68357f86-bd7b-42ea-b34e-56648d998f55 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:17.324659 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-68357f86-bd7b-42ea-b34e-56648d998f55 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:17.325111 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-68357f86-bd7b-42ea-b34e-56648d998f55 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:17.325536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-68357f86-bd7b-42ea-b34e-56648d998f55 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:17.328238 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:17.417107 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b6953a6a-6dad-4a44-b249-82fdf35fdec2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:17.417927 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b6953a6a-6dad-4a44-b249-82fdf35fdec2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:17.424625 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b6953a6a-6dad-4a44-b249-82fdf35fdec2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:17.425139 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b6953a6a-6dad-4a44-b249-82fdf35fdec2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:17.425641 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b6953a6a-6dad-4a44-b249-82fdf35fdec2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:17.426372 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b6953a6a-6dad-4a44-b249-82fdf35fdec2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:17.426827 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b6953a6a-6dad-4a44-b249-82fdf35fdec2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:17.427273 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b6953a6a-6dad-4a44-b249-82fdf35fdec2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:17.481315 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-68357f86-bd7b-42ea-b34e-56648d998f55 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:17.489616 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-68357f86-bd7b-42ea-b34e-56648d998f55 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1265 microversion: 2.1 time: 0.177523 Aug 08 14:36:17.490393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 410/852] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:17 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:17.565773 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b6953a6a-6dad-4a44-b249-82fdf35fdec2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:17.575133 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b6953a6a-6dad-4a44-b249-82fdf35fdec2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1731 microversion: 2.1 time: 0.163726 Aug 08 14:36:17.575820 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 443/853] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:17 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:17.599465 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e72b2390-1fe2-4c4d-8216-d0962178327a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:17.599972 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e72b2390-1fe2-4c4d-8216-d0962178327a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:17.606283 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e72b2390-1fe2-4c4d-8216-d0962178327a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:17.606902 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e72b2390-1fe2-4c4d-8216-d0962178327a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:17.607516 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e72b2390-1fe2-4c4d-8216-d0962178327a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:17.608225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e72b2390-1fe2-4c4d-8216-d0962178327a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:17.608674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e72b2390-1fe2-4c4d-8216-d0962178327a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:17.609100 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e72b2390-1fe2-4c4d-8216-d0962178327a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:17.694613 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e72b2390-1fe2-4c4d-8216-d0962178327a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101871 Aug 08 14:36:17.695277 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 411/854] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 14:36:17 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:18.510202 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-172e5fc8-3cbc-477f-907c-576da764c187 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:18.511520 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-172e5fc8-3cbc-477f-907c-576da764c187 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:18.519603 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-172e5fc8-3cbc-477f-907c-576da764c187 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:18.520092 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-172e5fc8-3cbc-477f-907c-576da764c187 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:18.520532 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-172e5fc8-3cbc-477f-907c-576da764c187 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:18.521228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-172e5fc8-3cbc-477f-907c-576da764c187 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:18.521669 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-172e5fc8-3cbc-477f-907c-576da764c187 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:18.522095 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-172e5fc8-3cbc-477f-907c-576da764c187 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:18.642639 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-2450cf18-d369-4580-a9e8-d400d8ecee6c req-afd918f1-f8c9-46b2-9e3e-31fededf36c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8", "tag": "ecab4c77-001d-40fa-84b2-143d50377acf"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:18.654580 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2450cf18-d369-4580-a9e8-d400d8ecee6c req-afd918f1-f8c9-46b2-9e3e-31fededf36c5 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:18.655277 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2450cf18-d369-4580-a9e8-d400d8ecee6c req-afd918f1-f8c9-46b2-9e3e-31fededf36c5 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:18.655897 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2450cf18-d369-4580-a9e8-d400d8ecee6c req-afd918f1-f8c9-46b2-9e3e-31fededf36c5 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:18.668914 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-2450cf18-d369-4580-a9e8-d400d8ecee6c req-afd918f1-f8c9-46b2-9e3e-31fededf36c5 service nova] Creating event network-changed:ecab4c77-001d-40fa-84b2-143d50377acf for instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 on hv-cinder-85200 Aug 08 14:36:18.674366 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-2450cf18-d369-4580-a9e8-d400d8ecee6c req-afd918f1-f8c9-46b2-9e3e-31fededf36c5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036496 Aug 08 14:36:18.675248 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 412/855] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:18.725699 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-172e5fc8-3cbc-477f-907c-576da764c187 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:18.743474 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-172e5fc8-3cbc-477f-907c-576da764c187 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1452 microversion: 2.1 time: 0.237231 Aug 08 14:36:18.744223 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 444/856] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:18 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1452 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:18.765510 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d30955f1-867a-4a19-8cec-8d63e0222e77 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:18.766433 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d30955f1-867a-4a19-8cec-8d63e0222e77 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:18.774117 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d30955f1-867a-4a19-8cec-8d63e0222e77 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:18.774950 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d30955f1-867a-4a19-8cec-8d63e0222e77 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:18.775859 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d30955f1-867a-4a19-8cec-8d63e0222e77 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:18.776825 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d30955f1-867a-4a19-8cec-8d63e0222e77 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:18.777447 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d30955f1-867a-4a19-8cec-8d63e0222e77 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:18.778088 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d30955f1-867a-4a19-8cec-8d63e0222e77 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:18.938847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d30955f1-867a-4a19-8cec-8d63e0222e77 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:18.947154 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d30955f1-867a-4a19-8cec-8d63e0222e77 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1452 microversion: 2.1 time: 0.186036 Aug 08 14:36:18.951129 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 413/857] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:18 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:20.696280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-308bfd9e-9fca-469e-a09b-249bcd38391f req-ef524115-519e-4fac-a0f1-bb9eb604c26d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8", "tag": "ecab4c77-001d-40fa-84b2-143d50377acf"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:20.706837 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-308bfd9e-9fca-469e-a09b-249bcd38391f req-ef524115-519e-4fac-a0f1-bb9eb604c26d service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:20.707338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-308bfd9e-9fca-469e-a09b-249bcd38391f req-ef524115-519e-4fac-a0f1-bb9eb604c26d service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:20.707767 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-308bfd9e-9fca-469e-a09b-249bcd38391f req-ef524115-519e-4fac-a0f1-bb9eb604c26d service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:20.719335 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-308bfd9e-9fca-469e-a09b-249bcd38391f req-ef524115-519e-4fac-a0f1-bb9eb604c26d service nova] Creating event network-changed:ecab4c77-001d-40fa-84b2-143d50377acf for instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 on hv-cinder-85200 Aug 08 14:36:20.724163 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-308bfd9e-9fca-469e-a09b-249bcd38391f req-ef524115-519e-4fac-a0f1-bb9eb604c26d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031754 Aug 08 14:36:20.724792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 445/858] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:22.744364 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-e33a8f40-b858-47fb-b728-61f9c576e09b req-3427340e-4b23-4bd1-aa74-956803002a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb38e896-d3ab-4655-bcec-eef6e42c4de4", "tag": "a2298513-6cdb-40b2-88dd-cf9f7ad6d82e"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:22.754201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-e33a8f40-b858-47fb-b728-61f9c576e09b req-3427340e-4b23-4bd1-aa74-956803002a3a service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:22.755320 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-e33a8f40-b858-47fb-b728-61f9c576e09b req-3427340e-4b23-4bd1-aa74-956803002a3a service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:22.755746 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-e33a8f40-b858-47fb-b728-61f9c576e09b req-3427340e-4b23-4bd1-aa74-956803002a3a service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:22.766287 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-e33a8f40-b858-47fb-b728-61f9c576e09b req-3427340e-4b23-4bd1-aa74-956803002a3a service nova] Creating event network-changed:a2298513-6cdb-40b2-88dd-cf9f7ad6d82e for instance bb38e896-d3ab-4655-bcec-eef6e42c4de4 on hv-cinder-85200 Aug 08 14:36:22.771131 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-e33a8f40-b858-47fb-b728-61f9c576e09b req-3427340e-4b23-4bd1-aa74-956803002a3a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030389 Aug 08 14:36:22.772793 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 414/859] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:25.948534 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1c6baf4a-e6af-4cd7-aaf3-fc3cfadd16e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:25.950719 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1c6baf4a-e6af-4cd7-aaf3-fc3cfadd16e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:25.956859 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1c6baf4a-e6af-4cd7-aaf3-fc3cfadd16e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:25.957340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1c6baf4a-e6af-4cd7-aaf3-fc3cfadd16e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:25.957772 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1c6baf4a-e6af-4cd7-aaf3-fc3cfadd16e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:25.958461 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1c6baf4a-e6af-4cd7-aaf3-fc3cfadd16e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:25.958907 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1c6baf4a-e6af-4cd7-aaf3-fc3cfadd16e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:25.959350 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1c6baf4a-e6af-4cd7-aaf3-fc3cfadd16e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:25.987598 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1c6baf4a-e6af-4cd7-aaf3-fc3cfadd16e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044043 Aug 08 14:36:25.988141 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 446/860] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:36:25 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 14:36:26.055942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a1a81d0b-a658-4a1c-9538-5faf2ed727f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:26.056540 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a1a81d0b-a658-4a1c-9538-5faf2ed727f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:26.062578 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1a81d0b-a658-4a1c-9538-5faf2ed727f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:26.063065 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1a81d0b-a658-4a1c-9538-5faf2ed727f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:26.063540 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1a81d0b-a658-4a1c-9538-5faf2ed727f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:26.064236 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1a81d0b-a658-4a1c-9538-5faf2ed727f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:26.064694 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1a81d0b-a658-4a1c-9538-5faf2ed727f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:26.065124 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1a81d0b-a658-4a1c-9538-5faf2ed727f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:26.089851 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a1a81d0b-a658-4a1c-9538-5faf2ed727f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:36:26.162988 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a1a81d0b-a658-4a1c-9538-5faf2ed727f2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 204 len: 0 microversion: 2.1 time: 0.112098 Aug 08 14:36:26.164052 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 415/861] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:36:26 2022] DELETE /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:36:26.173035 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2ec0cb5d-ecc0-4ada-ba0f-b268c296eb4d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:26.173632 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2ec0cb5d-ecc0-4ada-ba0f-b268c296eb4d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:26.180112 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2ec0cb5d-ecc0-4ada-ba0f-b268c296eb4d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:26.180597 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2ec0cb5d-ecc0-4ada-ba0f-b268c296eb4d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:26.181024 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2ec0cb5d-ecc0-4ada-ba0f-b268c296eb4d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:26.181706 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2ec0cb5d-ecc0-4ada-ba0f-b268c296eb4d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:26.182157 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2ec0cb5d-ecc0-4ada-ba0f-b268c296eb4d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:26.182574 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2ec0cb5d-ecc0-4ada-ba0f-b268c296eb4d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:26.316077 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2ec0cb5d-ecc0-4ada-ba0f-b268c296eb4d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:26.323629 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2ec0cb5d-ecc0-4ada-ba0f-b268c296eb4d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1671 microversion: 2.1 time: 0.154542 Aug 08 14:36:26.324200 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 447/862] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:26 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:27.346343 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7ebaeead-8480-4369-a5d6-66260dcd914d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:27.347036 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7ebaeead-8480-4369-a5d6-66260dcd914d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:27.354127 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ebaeead-8480-4369-a5d6-66260dcd914d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:27.354612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ebaeead-8480-4369-a5d6-66260dcd914d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:27.355046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ebaeead-8480-4369-a5d6-66260dcd914d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:27.355763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ebaeead-8480-4369-a5d6-66260dcd914d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:27.356222 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ebaeead-8480-4369-a5d6-66260dcd914d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:27.356643 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ebaeead-8480-4369-a5d6-66260dcd914d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:27.488038 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7ebaeead-8480-4369-a5d6-66260dcd914d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:27.496156 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7ebaeead-8480-4369-a5d6-66260dcd914d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1671 microversion: 2.1 time: 0.154087 Aug 08 14:36:27.496724 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 416/863] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:27 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:28.517389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7715380c-c5ed-4b2e-bced-f64a67fe1767 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:28.518593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7715380c-c5ed-4b2e-bced-f64a67fe1767 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:28.526186 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7715380c-c5ed-4b2e-bced-f64a67fe1767 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:28.526683 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7715380c-c5ed-4b2e-bced-f64a67fe1767 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:28.527260 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7715380c-c5ed-4b2e-bced-f64a67fe1767 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:28.527824 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7715380c-c5ed-4b2e-bced-f64a67fe1767 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:28.528238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7715380c-c5ed-4b2e-bced-f64a67fe1767 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:28.528653 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7715380c-c5ed-4b2e-bced-f64a67fe1767 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:28.658041 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7715380c-c5ed-4b2e-bced-f64a67fe1767 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:28.665779 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7715380c-c5ed-4b2e-bced-f64a67fe1767 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1671 microversion: 2.1 time: 0.152393 Aug 08 14:36:28.666347 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 448/864] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:28 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:29.687251 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-90fb0538-32d9-47fb-be7e-fc85651419a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:29.688561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-90fb0538-32d9-47fb-be7e-fc85651419a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:29.696149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90fb0538-32d9-47fb-be7e-fc85651419a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:29.696944 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90fb0538-32d9-47fb-be7e-fc85651419a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:29.697717 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90fb0538-32d9-47fb-be7e-fc85651419a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:29.698663 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90fb0538-32d9-47fb-be7e-fc85651419a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:29.699616 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90fb0538-32d9-47fb-be7e-fc85651419a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:29.700338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90fb0538-32d9-47fb-be7e-fc85651419a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:29.749336 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-2283dd36-5504-41d0-8bd1-a0a55644c706 req-a124aee0-9d61-40f9-b351-a3cc48073073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c76439-3c30-47b1-a13c-cee630ea057b", "name": "network-vif-deleted", "tag": "354b296f-263e-4dae-87aa-7cee7e4a17bd"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:29.751241 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90fb0538-32d9-47fb-be7e-fc85651419a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:29.752079 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90fb0538-32d9-47fb-be7e-fc85651419a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:29.752750 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-90fb0538-32d9-47fb-be7e-fc85651419a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:29.753479 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-90fb0538-32d9-47fb-be7e-fc85651419a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lazy-loading 'fault' on Instance uuid b4c76439-3c30-47b1-a13c-cee630ea057b {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:36:29.761954 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2283dd36-5504-41d0-8bd1-a0a55644c706 req-a124aee0-9d61-40f9-b351-a3cc48073073 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:29.762793 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2283dd36-5504-41d0-8bd1-a0a55644c706 req-a124aee0-9d61-40f9-b351-a3cc48073073 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:29.765210 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2283dd36-5504-41d0-8bd1-a0a55644c706 req-a124aee0-9d61-40f9-b351-a3cc48073073 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:29.779931 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-2283dd36-5504-41d0-8bd1-a0a55644c706 req-a124aee0-9d61-40f9-b351-a3cc48073073 service nova] Creating event network-vif-deleted:354b296f-263e-4dae-87aa-7cee7e4a17bd for instance b4c76439-3c30-47b1-a13c-cee630ea057b on hv-cinder-85200 Aug 08 14:36:29.786203 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-2283dd36-5504-41d0-8bd1-a0a55644c706 req-a124aee0-9d61-40f9-b351-a3cc48073073 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194028 Aug 08 14:36:29.788130 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 417/865] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:36:29.800531 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-90fb0538-32d9-47fb-be7e-fc85651419a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:29.809644 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-90fb0538-32d9-47fb-be7e-fc85651419a5 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 200 len: 1325 microversion: 2.1 time: 0.126314 Aug 08 14:36:29.814944 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 449/866] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:29 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 1325 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:30.832388 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a38b51f7-9e35-41bc-b853-153593ae95da tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:30.833103 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a38b51f7-9e35-41bc-b853-153593ae95da tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:30.839711 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a38b51f7-9e35-41bc-b853-153593ae95da tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:30.840156 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a38b51f7-9e35-41bc-b853-153593ae95da tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:30.840573 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a38b51f7-9e35-41bc-b853-153593ae95da tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:30.841271 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a38b51f7-9e35-41bc-b853-153593ae95da tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:30.841755 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a38b51f7-9e35-41bc-b853-153593ae95da tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:30.842175 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a38b51f7-9e35-41bc-b853-153593ae95da tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:30.858381 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-a38b51f7-9e35-41bc-b853-153593ae95da tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] HTTP exception thrown: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a38b51f7-9e35-41bc-b853-153593ae95da tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Request method failure captured: Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b HTTP/1.1 Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4krfH33h-RX4izJJDTSVG0g4ILn0N57NAFeoqYn8g7QS4HpLjKpfsLIP8ZWT12akAoH26m_fwmGqVsgmFaHbNUwKyQ0pgB0hTKrei-TDO9eeIZKJoWGFsG8zhRMe3wzi4wDoPECfUZDg3DA4C9FuxMWkvSNJPrBM1YAG8kagi_miM Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 0400861a88074a1480b54ce5e651cc76 Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:36:30.860068 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:36:30.861675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0400861a88074a1480b54ce5e651cc76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0400861a88074a1480b54ce5e651cc76", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0400861a88074a1480b54ce5e651cc76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0400861a88074a1480b54ce5e651cc76"}]}] Aug 08 14:36:30.861675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:36:30.861675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 0400861a88074a1480b54ce5e651cc76 Aug 08 14:36:30.861675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:36:30.861675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeTestJSON-1772828726-project Aug 08 14:36:30.861675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:36:30.861675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:36:30.861675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 75b75be070a147fba4788b0f51d8d0fb Aug 08 14:36:30.861675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeTestJSON-1772828726-project Aug 08 14:36:30.861675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:36:30.861675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:36:30.861675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'b4c76439-3c30-47b1-a13c-cee630ea057b'} Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:36:30.862606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:36:30.864245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:36:30.865570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a38b51f7-9e35-41bc-b853-153593ae95da tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Returning 404 to user: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:36:30.865570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a38b51f7-9e35-41bc-b853-153593ae95da tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 404 len: 111 microversion: 2.1 time: 0.033759 Aug 08 14:36:30.865570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 418/867] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:30 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:36:30.870385 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d5be01f3-5ae2-4699-bf9e-0d0f1caef478 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '.version_select at 0x7f9cb23df280>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:30.889306 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d5be01f3-5ae2-4699-bf9e-0d0f1caef478 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67406348" status: 202 len: 0 microversion: 2.1 time: 0.022733 Aug 08 14:36:30.889865 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 450/868] 10.222.0.50 () {58 vars in 1215 bytes} [Mon Aug 8 14:36:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67406348 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:36:31.516170 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d7661dfc-c125-48cc-957a-6e8667107bfc tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Action: 'create', calling method: .version_select at 0x7f9cb227c160>, body: {"keypair": {"name": "tempest-keypair-1840340557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeDSQmjLVjIE53UvMALFz1uz20AmaF7Idiei0Qf/yQxOkxlijkWV1sP+57OS3ugBuVifXkYeVboedtC8DLd/NyVOAze8UmHq81aFq5oIMhA7houP5wST4auLT0Zk2c/Jg=="}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:31.531169 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-d7661dfc-c125-48cc-957a-6e8667107bfc tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Getting quotas for project 0400861a88074a1480b54ce5e651cc76. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:36:31.534896 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-d7661dfc-c125-48cc-957a-6e8667107bfc tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Getting quotas for user 75b75be070a147fba4788b0f51d8d0fb and project 0400861a88074a1480b54ce5e651cc76. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:36:31.556614 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d7661dfc-c125-48cc-957a-6e8667107bfc tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044359 Aug 08 14:36:31.557202 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 419/869] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 14:36:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:32.782043 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2090752488", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f929f776-61ed-4a69-83e4-c03b4b7011a5"}], "security_groups": [{"name": "tempest-securitygroup--1181381570"}], "key_name": "tempest-keypair-1840340557", "user_data": "}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:32.889235 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.network.neutron [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] validate_networks() for [('f929f776-61ed-4a69-83e4-c03b4b7011a5', None, None, None, None, None)] {{(pid=118062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:36:33.293379 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Flavor limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:36:33.293799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Image limits 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:36:33.294271 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Flavor pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:36:33.294676 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Image pref 0:0:0 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:36:33.295083 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.virt.hardware [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:36:33.304193 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:33.304666 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:33.305092 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:33.305801 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:33.306247 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:33.306663 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:33.323395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Getting quotas for project 0400861a88074a1480b54ce5e651cc76. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:36:33.327254 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.quota [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Getting quotas for user 75b75be070a147fba4788b0f51d8d0fb and project 0400861a88074a1480b54ce5e651cc76. Resources: {'instances', 'cores', 'ram'} {{(pid=118062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:36:33.338012 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Going to run 1 instances... {{(pid=118062) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:36:33.340282 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:36:33.385274 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-102878d9-2eec-434b-b237-a8c4b41ceea1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.608034 Aug 08 14:36:33.385917 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 451/870] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:36:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:36:33.397222 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e693652f-6b61-4695-a8cf-4f24342c072f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:33.397917 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e693652f-6b61-4695-a8cf-4f24342c072f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:33.453052 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e693652f-6b61-4695-a8cf-4f24342c072f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:33.460548 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e693652f-6b61-4695-a8cf-4f24342c072f tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 200 len: 1238 microversion: 2.1 time: 0.067670 Aug 08 14:36:33.461329 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 420/871] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:33 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:34.481518 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-45de3d5a-fb62-441f-81fb-7c2b0a20c3e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:34.482238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-45de3d5a-fb62-441f-81fb-7c2b0a20c3e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:34.489038 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45de3d5a-fb62-441f-81fb-7c2b0a20c3e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:34.489452 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45de3d5a-fb62-441f-81fb-7c2b0a20c3e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:34.490371 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45de3d5a-fb62-441f-81fb-7c2b0a20c3e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:34.491105 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45de3d5a-fb62-441f-81fb-7c2b0a20c3e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:34.491561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45de3d5a-fb62-441f-81fb-7c2b0a20c3e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:34.491979 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45de3d5a-fb62-441f-81fb-7c2b0a20c3e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:34.561276 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-45de3d5a-fb62-441f-81fb-7c2b0a20c3e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:34.570446 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-45de3d5a-fb62-441f-81fb-7c2b0a20c3e8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 200 len: 1290 microversion: 2.1 time: 0.093215 Aug 08 14:36:34.571432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 452/872] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:34 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 1290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:35.592002 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-caf74f3f-0674-49a2-8baf-f949ee1d2247 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:35.592714 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-caf74f3f-0674-49a2-8baf-f949ee1d2247 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:35.599079 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caf74f3f-0674-49a2-8baf-f949ee1d2247 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:35.599596 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caf74f3f-0674-49a2-8baf-f949ee1d2247 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:35.600033 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caf74f3f-0674-49a2-8baf-f949ee1d2247 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:35.600734 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caf74f3f-0674-49a2-8baf-f949ee1d2247 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:35.601186 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caf74f3f-0674-49a2-8baf-f949ee1d2247 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:35.601611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caf74f3f-0674-49a2-8baf-f949ee1d2247 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:35.758582 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-caf74f3f-0674-49a2-8baf-f949ee1d2247 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:35.772255 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-caf74f3f-0674-49a2-8baf-f949ee1d2247 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 200 len: 1364 microversion: 2.1 time: 0.183167 Aug 08 14:36:35.773199 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 421/873] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:35 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:35.998246 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-cb40d82a-4540-4581-85c7-6e8c9c549a45 req-3a80b0ff-4375-4cbf-b2df-469bd6e6da3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2336777d-8558-4c8d-bfcf-9d9959574ba6", "tag": "c33a1d22-777b-4ccc-9d64-6225c5227a29"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:36.010867 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-cb40d82a-4540-4581-85c7-6e8c9c549a45 req-3a80b0ff-4375-4cbf-b2df-469bd6e6da3a service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:36.011465 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-cb40d82a-4540-4581-85c7-6e8c9c549a45 req-3a80b0ff-4375-4cbf-b2df-469bd6e6da3a service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:36.011901 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-cb40d82a-4540-4581-85c7-6e8c9c549a45 req-3a80b0ff-4375-4cbf-b2df-469bd6e6da3a service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:36.032203 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-cb40d82a-4540-4581-85c7-6e8c9c549a45 req-3a80b0ff-4375-4cbf-b2df-469bd6e6da3a service nova] Creating event network-changed:c33a1d22-777b-4ccc-9d64-6225c5227a29 for instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 on hv-cinder-85200 Aug 08 14:36:36.037240 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-cb40d82a-4540-4581-85c7-6e8c9c549a45 req-3a80b0ff-4375-4cbf-b2df-469bd6e6da3a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044872 Aug 08 14:36:36.038010 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 453/874] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:36.306234 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ae3ad90f-a653-45ed-a504-3b010b76ffe9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:36.308473 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ae3ad90f-a653-45ed-a504-3b010b76ffe9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:36.315105 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ae3ad90f-a653-45ed-a504-3b010b76ffe9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:36.315634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ae3ad90f-a653-45ed-a504-3b010b76ffe9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:36.316074 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ae3ad90f-a653-45ed-a504-3b010b76ffe9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:36.316787 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ae3ad90f-a653-45ed-a504-3b010b76ffe9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:36.317244 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ae3ad90f-a653-45ed-a504-3b010b76ffe9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:36.317674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ae3ad90f-a653-45ed-a504-3b010b76ffe9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:36.390452 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ae3ad90f-a653-45ed-a504-3b010b76ffe9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "POST /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/action" status: 202 len: 0 microversion: 2.1 time: 0.088850 Aug 08 14:36:36.391498 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 422/875] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 14:36:36 2022] POST /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:36:36.400465 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ebbc614e-c3e7-4859-b692-b3fb555124e9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:36.401190 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ebbc614e-c3e7-4859-b692-b3fb555124e9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:36.407715 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ebbc614e-c3e7-4859-b692-b3fb555124e9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:36.408462 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ebbc614e-c3e7-4859-b692-b3fb555124e9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:36.408993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ebbc614e-c3e7-4859-b692-b3fb555124e9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:36.410352 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ebbc614e-c3e7-4859-b692-b3fb555124e9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:36.411358 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ebbc614e-c3e7-4859-b692-b3fb555124e9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:36.412343 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ebbc614e-c3e7-4859-b692-b3fb555124e9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:36.565431 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ebbc614e-c3e7-4859-b692-b3fb555124e9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:36.574445 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ebbc614e-c3e7-4859-b692-b3fb555124e9 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1752 microversion: 2.1 time: 0.178440 Aug 08 14:36:36.575345 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 454/876] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:36 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:36.795419 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3edf0375-6250-4bde-9cc6-388fd2619e75 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:36.796132 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3edf0375-6250-4bde-9cc6-388fd2619e75 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:36.802189 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3edf0375-6250-4bde-9cc6-388fd2619e75 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:36.802669 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3edf0375-6250-4bde-9cc6-388fd2619e75 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:36.803117 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3edf0375-6250-4bde-9cc6-388fd2619e75 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:36.803802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3edf0375-6250-4bde-9cc6-388fd2619e75 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:36.804250 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3edf0375-6250-4bde-9cc6-388fd2619e75 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:36.804667 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3edf0375-6250-4bde-9cc6-388fd2619e75 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:36.941017 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3edf0375-6250-4bde-9cc6-388fd2619e75 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:36.949216 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3edf0375-6250-4bde-9cc6-388fd2619e75 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 200 len: 1364 microversion: 2.1 time: 0.158537 Aug 08 14:36:36.950010 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 423/877] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:36 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:37.596059 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c8e7730d-65dd-4eea-96e8-ffc31e8dae19 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:37.596668 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c8e7730d-65dd-4eea-96e8-ffc31e8dae19 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:37.603116 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c8e7730d-65dd-4eea-96e8-ffc31e8dae19 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:37.603599 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c8e7730d-65dd-4eea-96e8-ffc31e8dae19 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:37.604026 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c8e7730d-65dd-4eea-96e8-ffc31e8dae19 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:37.604705 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c8e7730d-65dd-4eea-96e8-ffc31e8dae19 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:37.605157 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c8e7730d-65dd-4eea-96e8-ffc31e8dae19 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:37.605572 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c8e7730d-65dd-4eea-96e8-ffc31e8dae19 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:37.744990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c8e7730d-65dd-4eea-96e8-ffc31e8dae19 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:37.752852 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c8e7730d-65dd-4eea-96e8-ffc31e8dae19 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1752 microversion: 2.1 time: 0.160959 Aug 08 14:36:37.753411 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 455/878] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:37 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:37.969968 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c9f03854-68e5-4aed-8a0d-ac14df8c7b18 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:37.970611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c9f03854-68e5-4aed-8a0d-ac14df8c7b18 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:37.977079 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9f03854-68e5-4aed-8a0d-ac14df8c7b18 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:37.977560 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9f03854-68e5-4aed-8a0d-ac14df8c7b18 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:37.977996 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9f03854-68e5-4aed-8a0d-ac14df8c7b18 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:37.978683 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9f03854-68e5-4aed-8a0d-ac14df8c7b18 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:37.979163 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9f03854-68e5-4aed-8a0d-ac14df8c7b18 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:37.979593 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9f03854-68e5-4aed-8a0d-ac14df8c7b18 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:38.114347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c9f03854-68e5-4aed-8a0d-ac14df8c7b18 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:38.121828 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c9f03854-68e5-4aed-8a0d-ac14df8c7b18 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 200 len: 1364 microversion: 2.1 time: 0.155717 Aug 08 14:36:38.122406 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 424/879] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:37 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:38.774976 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-015cfada-cecf-4e7a-aaaf-7a72e9d4a4a5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:38.775622 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-015cfada-cecf-4e7a-aaaf-7a72e9d4a4a5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:38.778332 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:38.785314 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-015cfada-cecf-4e7a-aaaf-7a72e9d4a4a5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:38.785989 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-015cfada-cecf-4e7a-aaaf-7a72e9d4a4a5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:38.786509 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-015cfada-cecf-4e7a-aaaf-7a72e9d4a4a5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:38.787302 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-015cfada-cecf-4e7a-aaaf-7a72e9d4a4a5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:38.787767 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-015cfada-cecf-4e7a-aaaf-7a72e9d4a4a5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:38.788487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-015cfada-cecf-4e7a-aaaf-7a72e9d4a4a5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:38.930517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-015cfada-cecf-4e7a-aaaf-7a72e9d4a4a5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:38.938543 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-015cfada-cecf-4e7a-aaaf-7a72e9d4a4a5 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.168006 Aug 08 14:36:38.939129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 456/880] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:38 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:39.142768 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c8e10b3e-f030-422a-a817-16f084fc55b9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:39.143395 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c8e10b3e-f030-422a-a817-16f084fc55b9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:39.149714 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8e10b3e-f030-422a-a817-16f084fc55b9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:39.150189 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8e10b3e-f030-422a-a817-16f084fc55b9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:39.150617 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8e10b3e-f030-422a-a817-16f084fc55b9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:39.151342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8e10b3e-f030-422a-a817-16f084fc55b9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:39.151789 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8e10b3e-f030-422a-a817-16f084fc55b9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:39.152206 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8e10b3e-f030-422a-a817-16f084fc55b9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:39.279034 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c8e10b3e-f030-422a-a817-16f084fc55b9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:39.286353 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c8e10b3e-f030-422a-a817-16f084fc55b9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 200 len: 1364 microversion: 2.1 time: 0.147489 Aug 08 14:36:39.287439 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 425/881] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:39 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:39.959553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d9dc4640-2d78-4f7d-97f6-fda4c3104a2b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:39.960193 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d9dc4640-2d78-4f7d-97f6-fda4c3104a2b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:39.966433 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d9dc4640-2d78-4f7d-97f6-fda4c3104a2b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:39.966910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d9dc4640-2d78-4f7d-97f6-fda4c3104a2b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:39.967394 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d9dc4640-2d78-4f7d-97f6-fda4c3104a2b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:39.968082 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d9dc4640-2d78-4f7d-97f6-fda4c3104a2b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:39.968535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d9dc4640-2d78-4f7d-97f6-fda4c3104a2b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:39.968946 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d9dc4640-2d78-4f7d-97f6-fda4c3104a2b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:40.115481 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d9dc4640-2d78-4f7d-97f6-fda4c3104a2b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:40.123386 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d9dc4640-2d78-4f7d-97f6-fda4c3104a2b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.167708 Aug 08 14:36:40.123948 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 457/882] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:39 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:40.308055 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d052e527-173e-4c36-8b1c-eaab5c88e104 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:40.308714 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d052e527-173e-4c36-8b1c-eaab5c88e104 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:40.315045 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d052e527-173e-4c36-8b1c-eaab5c88e104 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:40.315559 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d052e527-173e-4c36-8b1c-eaab5c88e104 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:40.315993 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d052e527-173e-4c36-8b1c-eaab5c88e104 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:40.316683 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d052e527-173e-4c36-8b1c-eaab5c88e104 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:40.317136 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d052e527-173e-4c36-8b1c-eaab5c88e104 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:40.317559 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d052e527-173e-4c36-8b1c-eaab5c88e104 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:40.449774 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d052e527-173e-4c36-8b1c-eaab5c88e104 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:40.457594 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d052e527-173e-4c36-8b1c-eaab5c88e104 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 200 len: 1364 microversion: 2.1 time: 0.153332 Aug 08 14:36:40.458164 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 426/883] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:40 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:36:41.143932 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f29ae4a1-e3d1-4495-aff5-05f9e107d07a tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:41.144468 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f29ae4a1-e3d1-4495-aff5-05f9e107d07a tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:41.151389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f29ae4a1-e3d1-4495-aff5-05f9e107d07a tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:41.151865 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f29ae4a1-e3d1-4495-aff5-05f9e107d07a tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:41.152300 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f29ae4a1-e3d1-4495-aff5-05f9e107d07a tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:41.152981 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f29ae4a1-e3d1-4495-aff5-05f9e107d07a tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:41.153429 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f29ae4a1-e3d1-4495-aff5-05f9e107d07a tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:41.153849 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f29ae4a1-e3d1-4495-aff5-05f9e107d07a tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:41.294850 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f29ae4a1-e3d1-4495-aff5-05f9e107d07a tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:41.303194 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f29ae4a1-e3d1-4495-aff5-05f9e107d07a tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.163186 Aug 08 14:36:41.303757 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 458/884] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:41 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:41.477826 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4b3d09d0-1f84-4504-9c13-c4e0ec002303 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:41.478400 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4b3d09d0-1f84-4504-9c13-c4e0ec002303 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:41.484712 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b3d09d0-1f84-4504-9c13-c4e0ec002303 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:41.485196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b3d09d0-1f84-4504-9c13-c4e0ec002303 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:41.485629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b3d09d0-1f84-4504-9c13-c4e0ec002303 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:41.486323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b3d09d0-1f84-4504-9c13-c4e0ec002303 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:41.486773 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b3d09d0-1f84-4504-9c13-c4e0ec002303 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:41.487221 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b3d09d0-1f84-4504-9c13-c4e0ec002303 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:41.615602 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4b3d09d0-1f84-4504-9c13-c4e0ec002303 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:41.622929 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4b3d09d0-1f84-4504-9c13-c4e0ec002303 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 200 len: 1364 microversion: 2.1 time: 0.149075 Aug 08 14:36:41.623523 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 427/885] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:41 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:42.040308 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-05d53c6e-8b8b-4432-ae36-a0cd8a344980 req-3decb643-6f67-4958-96fd-55ba6f3a717c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2336777d-8558-4c8d-bfcf-9d9959574ba6", "name": "network-vif-plugged", "status": "completed", "tag": "c33a1d22-777b-4ccc-9d64-6225c5227a29"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:42.049858 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-05d53c6e-8b8b-4432-ae36-a0cd8a344980 req-3decb643-6f67-4958-96fd-55ba6f3a717c service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:42.050333 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-05d53c6e-8b8b-4432-ae36-a0cd8a344980 req-3decb643-6f67-4958-96fd-55ba6f3a717c service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:42.050758 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-05d53c6e-8b8b-4432-ae36-a0cd8a344980 req-3decb643-6f67-4958-96fd-55ba6f3a717c service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:42.061501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-05d53c6e-8b8b-4432-ae36-a0cd8a344980 req-3decb643-6f67-4958-96fd-55ba6f3a717c service nova] Creating event network-vif-plugged:c33a1d22-777b-4ccc-9d64-6225c5227a29 for instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 on hv-cinder-85200 Aug 08 14:36:42.066096 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-05d53c6e-8b8b-4432-ae36-a0cd8a344980 req-3decb643-6f67-4958-96fd-55ba6f3a717c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089209 Aug 08 14:36:42.066752 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 459/886] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:42.324290 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7fe12240-e93c-4bbb-8441-2c32b8ca602b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:42.324891 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7fe12240-e93c-4bbb-8441-2c32b8ca602b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:42.330617 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7fe12240-e93c-4bbb-8441-2c32b8ca602b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:42.331122 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7fe12240-e93c-4bbb-8441-2c32b8ca602b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:42.331556 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7fe12240-e93c-4bbb-8441-2c32b8ca602b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:42.332233 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7fe12240-e93c-4bbb-8441-2c32b8ca602b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:42.332679 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7fe12240-e93c-4bbb-8441-2c32b8ca602b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:42.333111 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7fe12240-e93c-4bbb-8441-2c32b8ca602b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:42.474666 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7fe12240-e93c-4bbb-8441-2c32b8ca602b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:42.482958 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7fe12240-e93c-4bbb-8441-2c32b8ca602b tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.162587 Aug 08 14:36:42.483558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 428/887] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:42 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:42.644331 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-db93e129-6646-4f2a-bbe9-3ec83eaa4933 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:42.645018 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-db93e129-6646-4f2a-bbe9-3ec83eaa4933 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:42.651692 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db93e129-6646-4f2a-bbe9-3ec83eaa4933 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:42.652171 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db93e129-6646-4f2a-bbe9-3ec83eaa4933 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:42.652602 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db93e129-6646-4f2a-bbe9-3ec83eaa4933 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:42.653287 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db93e129-6646-4f2a-bbe9-3ec83eaa4933 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:42.653737 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db93e129-6646-4f2a-bbe9-3ec83eaa4933 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:42.654158 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-db93e129-6646-4f2a-bbe9-3ec83eaa4933 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:42.782706 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-db93e129-6646-4f2a-bbe9-3ec83eaa4933 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:42.790296 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-db93e129-6646-4f2a-bbe9-3ec83eaa4933 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 200 len: 1364 microversion: 2.1 time: 0.150722 Aug 08 14:36:42.790852 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 460/888] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:42 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:43.503380 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4a926d78-f7d1-48d2-a03c-08d9d6589ef2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:43.503992 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4a926d78-f7d1-48d2-a03c-08d9d6589ef2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:43.505996 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=6 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:43.511716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4a926d78-f7d1-48d2-a03c-08d9d6589ef2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:43.512199 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4a926d78-f7d1-48d2-a03c-08d9d6589ef2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:43.512637 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4a926d78-f7d1-48d2-a03c-08d9d6589ef2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:43.513327 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4a926d78-f7d1-48d2-a03c-08d9d6589ef2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:43.513777 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4a926d78-f7d1-48d2-a03c-08d9d6589ef2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:43.514200 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4a926d78-f7d1-48d2-a03c-08d9d6589ef2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:43.516801 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:43.662197 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4a926d78-f7d1-48d2-a03c-08d9d6589ef2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:43.670419 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4a926d78-f7d1-48d2-a03c-08d9d6589ef2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.170901 Aug 08 14:36:43.670975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 429/889] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:43 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:43.807405 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:43.808158 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=6 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:43.812788 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c364d1e6-c9b8-4124-9443-50eddb8dc363 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:43.813390 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c364d1e6-c9b8-4124-9443-50eddb8dc363 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:43.820541 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c364d1e6-c9b8-4124-9443-50eddb8dc363 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:43.821024 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c364d1e6-c9b8-4124-9443-50eddb8dc363 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:43.821462 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c364d1e6-c9b8-4124-9443-50eddb8dc363 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:43.822184 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c364d1e6-c9b8-4124-9443-50eddb8dc363 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:43.822643 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c364d1e6-c9b8-4124-9443-50eddb8dc363 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:43.823065 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c364d1e6-c9b8-4124-9443-50eddb8dc363 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:43.950586 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c364d1e6-c9b8-4124-9443-50eddb8dc363 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:43.958031 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c364d1e6-c9b8-4124-9443-50eddb8dc363 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 200 len: 1550 microversion: 2.1 time: 0.151551 Aug 08 14:36:43.959255 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 461/890] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:43 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:43.978691 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e7fe0726-4f57-4e07-a934-9cf5288c92b2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:43.979218 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e7fe0726-4f57-4e07-a934-9cf5288c92b2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:43.985171 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e7fe0726-4f57-4e07-a934-9cf5288c92b2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:43.985654 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e7fe0726-4f57-4e07-a934-9cf5288c92b2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:43.986093 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e7fe0726-4f57-4e07-a934-9cf5288c92b2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:43.987075 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e7fe0726-4f57-4e07-a934-9cf5288c92b2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:43.987563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e7fe0726-4f57-4e07-a934-9cf5288c92b2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:43.987992 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e7fe0726-4f57-4e07-a934-9cf5288c92b2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:44.063583 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e7fe0726-4f57-4e07-a934-9cf5288c92b2 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088640 Aug 08 14:36:44.064179 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 430/891] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 14:36:43 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:44.691415 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-63d83636-77a1-4d1c-a1e6-7275d104fba2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:44.692131 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-63d83636-77a1-4d1c-a1e6-7275d104fba2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:44.698229 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-63d83636-77a1-4d1c-a1e6-7275d104fba2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:44.698808 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-63d83636-77a1-4d1c-a1e6-7275d104fba2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:44.699271 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-63d83636-77a1-4d1c-a1e6-7275d104fba2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:44.699970 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-63d83636-77a1-4d1c-a1e6-7275d104fba2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:44.700430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-63d83636-77a1-4d1c-a1e6-7275d104fba2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:44.700851 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-63d83636-77a1-4d1c-a1e6-7275d104fba2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:44.926549 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-63d83636-77a1-4d1c-a1e6-7275d104fba2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:44.930590 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=100 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:44.935691 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-63d83636-77a1-4d1c-a1e6-7275d104fba2 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.248322 Aug 08 14:36:44.936355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 462/892] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:44 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:45.379548 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-0e419786-3f61-44a5-bfac-6eb240f03fc8 req-26b3c2cd-82ae-4b33-866d-01dc8d20ddba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2336777d-8558-4c8d-bfcf-9d9959574ba6", "tag": "c33a1d22-777b-4ccc-9d64-6225c5227a29"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:45.388854 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0e419786-3f61-44a5-bfac-6eb240f03fc8 req-26b3c2cd-82ae-4b33-866d-01dc8d20ddba service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:45.389337 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0e419786-3f61-44a5-bfac-6eb240f03fc8 req-26b3c2cd-82ae-4b33-866d-01dc8d20ddba service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:45.389772 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0e419786-3f61-44a5-bfac-6eb240f03fc8 req-26b3c2cd-82ae-4b33-866d-01dc8d20ddba service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:45.400583 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-0e419786-3f61-44a5-bfac-6eb240f03fc8 req-26b3c2cd-82ae-4b33-866d-01dc8d20ddba service nova] Creating event network-changed:c33a1d22-777b-4ccc-9d64-6225c5227a29 for instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 on hv-cinder-85200 Aug 08 14:36:45.405531 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-0e419786-3f61-44a5-bfac-6eb240f03fc8 req-26b3c2cd-82ae-4b33-866d-01dc8d20ddba service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083161 Aug 08 14:36:45.406206 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 431/893] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:36:45.957137 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7c928c6f-3097-407f-a6a3-51ce4581c40f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:45.957750 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7c928c6f-3097-407f-a6a3-51ce4581c40f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:45.964846 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7c928c6f-3097-407f-a6a3-51ce4581c40f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:45.965338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7c928c6f-3097-407f-a6a3-51ce4581c40f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:45.965779 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7c928c6f-3097-407f-a6a3-51ce4581c40f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:45.966485 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7c928c6f-3097-407f-a6a3-51ce4581c40f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:45.967063 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7c928c6f-3097-407f-a6a3-51ce4581c40f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:45.967399 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7c928c6f-3097-407f-a6a3-51ce4581c40f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:46.124614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7c928c6f-3097-407f-a6a3-51ce4581c40f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:46.133415 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7c928c6f-3097-407f-a6a3-51ce4581c40f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.180443 Aug 08 14:36:46.134005 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 463/894] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:45 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:47.156194 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-99e9f962-d8eb-4c48-89fc-4f51513a565f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:47.156834 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-99e9f962-d8eb-4c48-89fc-4f51513a565f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:47.158725 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:36:47.164821 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99e9f962-d8eb-4c48-89fc-4f51513a565f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:47.165296 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99e9f962-d8eb-4c48-89fc-4f51513a565f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:47.165726 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99e9f962-d8eb-4c48-89fc-4f51513a565f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:47.166408 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99e9f962-d8eb-4c48-89fc-4f51513a565f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:47.166854 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99e9f962-d8eb-4c48-89fc-4f51513a565f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:47.167309 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-99e9f962-d8eb-4c48-89fc-4f51513a565f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:47.308329 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-99e9f962-d8eb-4c48-89fc-4f51513a565f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:47.316153 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-99e9f962-d8eb-4c48-89fc-4f51513a565f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.164819 Aug 08 14:36:47.316715 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 432/895] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:47 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:48.337179 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-92940abc-79b7-428e-91d1-81137cd337b1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:48.337786 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-92940abc-79b7-428e-91d1-81137cd337b1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:48.344187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-92940abc-79b7-428e-91d1-81137cd337b1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:48.344666 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-92940abc-79b7-428e-91d1-81137cd337b1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:48.345128 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-92940abc-79b7-428e-91d1-81137cd337b1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:48.345804 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-92940abc-79b7-428e-91d1-81137cd337b1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:48.346255 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-92940abc-79b7-428e-91d1-81137cd337b1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:48.346674 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-92940abc-79b7-428e-91d1-81137cd337b1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:48.490143 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-92940abc-79b7-428e-91d1-81137cd337b1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:48.497965 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-92940abc-79b7-428e-91d1-81137cd337b1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.164734 Aug 08 14:36:48.498518 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 464/896] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:48 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:49.518539 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a9090f4c-3e00-42b2-a473-2aa17e3570b6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:49.519162 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a9090f4c-3e00-42b2-a473-2aa17e3570b6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:49.525358 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a9090f4c-3e00-42b2-a473-2aa17e3570b6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:49.525833 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a9090f4c-3e00-42b2-a473-2aa17e3570b6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:49.526265 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a9090f4c-3e00-42b2-a473-2aa17e3570b6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:49.526953 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a9090f4c-3e00-42b2-a473-2aa17e3570b6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:49.527428 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a9090f4c-3e00-42b2-a473-2aa17e3570b6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:49.527851 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a9090f4c-3e00-42b2-a473-2aa17e3570b6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:49.665511 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a9090f4c-3e00-42b2-a473-2aa17e3570b6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:49.673261 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a9090f4c-3e00-42b2-a473-2aa17e3570b6 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.158545 Aug 08 14:36:49.673813 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 433/897] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:49 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:50.694151 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-16308280-ee91-4da1-96d2-6b3c772e679c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:50.694757 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-16308280-ee91-4da1-96d2-6b3c772e679c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:50.701140 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16308280-ee91-4da1-96d2-6b3c772e679c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:50.701617 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16308280-ee91-4da1-96d2-6b3c772e679c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:50.702049 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16308280-ee91-4da1-96d2-6b3c772e679c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:50.702728 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16308280-ee91-4da1-96d2-6b3c772e679c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:50.703208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16308280-ee91-4da1-96d2-6b3c772e679c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:50.703631 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16308280-ee91-4da1-96d2-6b3c772e679c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:50.844714 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-16308280-ee91-4da1-96d2-6b3c772e679c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:50.852638 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-16308280-ee91-4da1-96d2-6b3c772e679c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.162861 Aug 08 14:36:50.853201 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 465/898] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:50 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:51.873303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-18590a21-f655-45fe-9ac2-4d174bbdc8ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:51.873918 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-18590a21-f655-45fe-9ac2-4d174bbdc8ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:51.880421 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18590a21-f655-45fe-9ac2-4d174bbdc8ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:51.880898 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18590a21-f655-45fe-9ac2-4d174bbdc8ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:51.881326 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18590a21-f655-45fe-9ac2-4d174bbdc8ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:51.882038 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18590a21-f655-45fe-9ac2-4d174bbdc8ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:51.882484 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18590a21-f655-45fe-9ac2-4d174bbdc8ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:51.882900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18590a21-f655-45fe-9ac2-4d174bbdc8ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:52.022496 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-18590a21-f655-45fe-9ac2-4d174bbdc8ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:52.030343 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-18590a21-f655-45fe-9ac2-4d174bbdc8ce tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.160904 Aug 08 14:36:52.031023 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 434/899] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:51 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:53.051967 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-da1fd083-2116-46f4-9856-b6d323b50e66 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:53.052578 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-da1fd083-2116-46f4-9856-b6d323b50e66 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:53.059025 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-da1fd083-2116-46f4-9856-b6d323b50e66 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:53.059544 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-da1fd083-2116-46f4-9856-b6d323b50e66 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:53.059978 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-da1fd083-2116-46f4-9856-b6d323b50e66 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:53.060663 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-da1fd083-2116-46f4-9856-b6d323b50e66 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:53.061119 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-da1fd083-2116-46f4-9856-b6d323b50e66 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:53.061543 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-da1fd083-2116-46f4-9856-b6d323b50e66 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:53.199411 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-da1fd083-2116-46f4-9856-b6d323b50e66 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:53.207257 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-da1fd083-2116-46f4-9856-b6d323b50e66 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.159185 Aug 08 14:36:53.207818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 466/900] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:53 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:54.228765 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-76a4d813-9e01-4c6a-8cff-f1086185a8ff tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:54.229278 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-76a4d813-9e01-4c6a-8cff-f1086185a8ff tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:54.235725 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76a4d813-9e01-4c6a-8cff-f1086185a8ff tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:54.236200 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76a4d813-9e01-4c6a-8cff-f1086185a8ff tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:54.236631 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76a4d813-9e01-4c6a-8cff-f1086185a8ff tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:54.237313 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76a4d813-9e01-4c6a-8cff-f1086185a8ff tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:54.237760 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76a4d813-9e01-4c6a-8cff-f1086185a8ff tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:54.238180 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76a4d813-9e01-4c6a-8cff-f1086185a8ff tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:54.382458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-76a4d813-9e01-4c6a-8cff-f1086185a8ff tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:54.390608 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-76a4d813-9e01-4c6a-8cff-f1086185a8ff tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.165807 Aug 08 14:36:54.391194 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 435/901] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:54 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:54.910403 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c0868fdf-f538-48c1-b31b-92e2fab53264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:54.910879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c0868fdf-f538-48c1-b31b-92e2fab53264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:54.917210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c0868fdf-f538-48c1-b31b-92e2fab53264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:54.917690 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c0868fdf-f538-48c1-b31b-92e2fab53264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:54.918124 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c0868fdf-f538-48c1-b31b-92e2fab53264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:54.918872 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c0868fdf-f538-48c1-b31b-92e2fab53264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:54.919356 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c0868fdf-f538-48c1-b31b-92e2fab53264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:54.919781 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c0868fdf-f538-48c1-b31b-92e2fab53264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:54.945131 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c0868fdf-f538-48c1-b31b-92e2fab53264 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93/ips" status: 200 len: 152 microversion: 2.20 time: 0.038884 Aug 08 14:36:54.945697 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 467/902] 10.222.0.50 () {60 vars in 1289 bytes} [Mon Aug 8 14:36:54 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:36:55.412205 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1acf8113-25a8-4560-9399-08ea1ce6e691 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:55.413087 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1acf8113-25a8-4560-9399-08ea1ce6e691 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:55.419593 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1acf8113-25a8-4560-9399-08ea1ce6e691 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:55.420069 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1acf8113-25a8-4560-9399-08ea1ce6e691 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:55.420501 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1acf8113-25a8-4560-9399-08ea1ce6e691 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:55.421181 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1acf8113-25a8-4560-9399-08ea1ce6e691 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:55.421624 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1acf8113-25a8-4560-9399-08ea1ce6e691 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:55.422043 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1acf8113-25a8-4560-9399-08ea1ce6e691 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:55.563668 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1acf8113-25a8-4560-9399-08ea1ce6e691 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:55.571793 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1acf8113-25a8-4560-9399-08ea1ce6e691 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.164011 Aug 08 14:36:55.572398 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 436/903] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:55 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:56.594127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6c636380-50e8-49c4-9fa3-b4b76ccc2f11 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:56.594763 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6c636380-50e8-49c4-9fa3-b4b76ccc2f11 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:56.601748 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c636380-50e8-49c4-9fa3-b4b76ccc2f11 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:56.602255 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c636380-50e8-49c4-9fa3-b4b76ccc2f11 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:56.602689 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c636380-50e8-49c4-9fa3-b4b76ccc2f11 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:56.603397 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c636380-50e8-49c4-9fa3-b4b76ccc2f11 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:56.603850 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c636380-50e8-49c4-9fa3-b4b76ccc2f11 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:56.604270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6c636380-50e8-49c4-9fa3-b4b76ccc2f11 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:56.749792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6c636380-50e8-49c4-9fa3-b4b76ccc2f11 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:56.757609 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6c636380-50e8-49c4-9fa3-b4b76ccc2f11 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.167383 Aug 08 14:36:56.758168 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 468/904] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:56 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:57.607411 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d35c9568-14df-4161-a5d3-7c9ae1fad8d0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:36:57.607970 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d35c9568-14df-4161-a5d3-7c9ae1fad8d0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:57.614230 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d35c9568-14df-4161-a5d3-7c9ae1fad8d0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:57.614709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d35c9568-14df-4161-a5d3-7c9ae1fad8d0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:57.615169 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d35c9568-14df-4161-a5d3-7c9ae1fad8d0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:57.615902 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d35c9568-14df-4161-a5d3-7c9ae1fad8d0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:57.616357 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d35c9568-14df-4161-a5d3-7c9ae1fad8d0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:57.616781 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d35c9568-14df-4161-a5d3-7c9ae1fad8d0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:57.639046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-d35c9568-14df-4161-a5d3-7c9ae1fad8d0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lazy-loading 'flavor' on Instance uuid c79aaf7b-bbdb-42b5-a337-89102612ff93 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:36:57.778447 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-93cd2327-91f1-4113-954d-678101e840f8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:57.779149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-93cd2327-91f1-4113-954d-678101e840f8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:57.785509 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-93cd2327-91f1-4113-954d-678101e840f8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:57.785986 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-93cd2327-91f1-4113-954d-678101e840f8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:57.786432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-93cd2327-91f1-4113-954d-678101e840f8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:57.787193 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-93cd2327-91f1-4113-954d-678101e840f8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:57.787908 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-93cd2327-91f1-4113-954d-678101e840f8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:57.788338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-93cd2327-91f1-4113-954d-678101e840f8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:57.811655 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d35c9568-14df-4161-a5d3-7c9ae1fad8d0 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "POST /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93/action" status: 202 len: 0 microversion: 2.20 time: 0.207999 Aug 08 14:36:57.812279 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 437/905] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Aug 8 14:36:57 2022] POST /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:36:57.821244 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-dd1187e5-f82a-4c8c-99e1-76580d170b6e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:57.821986 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-dd1187e5-f82a-4c8c-99e1-76580d170b6e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:57.828264 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dd1187e5-f82a-4c8c-99e1-76580d170b6e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:57.828750 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dd1187e5-f82a-4c8c-99e1-76580d170b6e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:57.829184 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dd1187e5-f82a-4c8c-99e1-76580d170b6e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:57.829883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dd1187e5-f82a-4c8c-99e1-76580d170b6e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:57.830330 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dd1187e5-f82a-4c8c-99e1-76580d170b6e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:57.830871 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dd1187e5-f82a-4c8c-99e1-76580d170b6e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:57.993338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-93cd2327-91f1-4113-954d-678101e840f8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:58.001143 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-93cd2327-91f1-4113-954d-678101e840f8 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.226711 Aug 08 14:36:58.001708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 469/906] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:57 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:58.016397 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-dd1187e5-f82a-4c8c-99e1-76580d170b6e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:58.024322 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-dd1187e5-f82a-4c8c-99e1-76580d170b6e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:58.025872 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-dd1187e5-f82a-4c8c-99e1-76580d170b6e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:58.027061 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-dd1187e5-f82a-4c8c-99e1-76580d170b6e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.210435 Aug 08 14:36:58.027631 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 438/907] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:36:57 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:36:59.022553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1ba324d7-96be-4def-9c96-2e9ee8a98871 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:59.023188 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1ba324d7-96be-4def-9c96-2e9ee8a98871 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:59.029530 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1ba324d7-96be-4def-9c96-2e9ee8a98871 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:59.030016 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1ba324d7-96be-4def-9c96-2e9ee8a98871 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:59.030461 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1ba324d7-96be-4def-9c96-2e9ee8a98871 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:59.031168 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1ba324d7-96be-4def-9c96-2e9ee8a98871 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:59.031640 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1ba324d7-96be-4def-9c96-2e9ee8a98871 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:59.032050 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1ba324d7-96be-4def-9c96-2e9ee8a98871 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:59.050364 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2e3c72b2-a2b2-4409-b0e1-0ed7fdfd41b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:36:59.051117 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2e3c72b2-a2b2-4409-b0e1-0ed7fdfd41b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:36:59.057502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e3c72b2-a2b2-4409-b0e1-0ed7fdfd41b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:59.057983 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e3c72b2-a2b2-4409-b0e1-0ed7fdfd41b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:59.058411 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e3c72b2-a2b2-4409-b0e1-0ed7fdfd41b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:59.059115 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e3c72b2-a2b2-4409-b0e1-0ed7fdfd41b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:36:59.059564 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e3c72b2-a2b2-4409-b0e1-0ed7fdfd41b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:36:59.059981 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e3c72b2-a2b2-4409-b0e1-0ed7fdfd41b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:36:59.244755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-1ba324d7-96be-4def-9c96-2e9ee8a98871 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:59.247866 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2e3c72b2-a2b2-4409-b0e1-0ed7fdfd41b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:59.252751 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1ba324d7-96be-4def-9c96-2e9ee8a98871 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1757 microversion: 2.1 time: 0.234638 Aug 08 14:36:59.253326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 470/908] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:36:59 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1757 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:36:59.256602 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2e3c72b2-a2b2-4409-b0e1-0ed7fdfd41b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:59.258170 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2e3c72b2-a2b2-4409-b0e1-0ed7fdfd41b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:36:59.259409 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2e3c72b2-a2b2-4409-b0e1-0ed7fdfd41b2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.212968 Aug 08 14:36:59.259954 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 439/909] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:36:59 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:00.274284 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-dc6058c5-783e-4c0d-8734-7309870f03cb tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:00.274831 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-dc6058c5-783e-4c0d-8734-7309870f03cb tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:00.281293 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dc6058c5-783e-4c0d-8734-7309870f03cb tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:00.281562 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-534845ea-8ab1-4f1b-9e86-f721bf47f8d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:00.281952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dc6058c5-783e-4c0d-8734-7309870f03cb tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:00.282163 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-534845ea-8ab1-4f1b-9e86-f721bf47f8d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:00.282268 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dc6058c5-783e-4c0d-8734-7309870f03cb tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:00.282891 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dc6058c5-783e-4c0d-8734-7309870f03cb tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:00.283378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dc6058c5-783e-4c0d-8734-7309870f03cb tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:00.283815 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dc6058c5-783e-4c0d-8734-7309870f03cb tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:00.289351 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-534845ea-8ab1-4f1b-9e86-f721bf47f8d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:00.289829 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-534845ea-8ab1-4f1b-9e86-f721bf47f8d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:00.290257 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-534845ea-8ab1-4f1b-9e86-f721bf47f8d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:00.290947 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-534845ea-8ab1-4f1b-9e86-f721bf47f8d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:00.291422 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-534845ea-8ab1-4f1b-9e86-f721bf47f8d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:00.291842 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-534845ea-8ab1-4f1b-9e86-f721bf47f8d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:00.494780 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-534845ea-8ab1-4f1b-9e86-f721bf47f8d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:00.500937 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-dc6058c5-783e-4c0d-8734-7309870f03cb tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:00.502715 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-534845ea-8ab1-4f1b-9e86-f721bf47f8d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:00.504260 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-534845ea-8ab1-4f1b-9e86-f721bf47f8d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:00.506064 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-534845ea-8ab1-4f1b-9e86-f721bf47f8d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.227642 Aug 08 14:37:00.506623 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 440/910] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:00 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:00.510144 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-dc6058c5-783e-4c0d-8734-7309870f03cb tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1760 microversion: 2.1 time: 0.240289 Aug 08 14:37:00.510713 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 471/911] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:00 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1760 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:01.529455 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1c349c7b-de16-4323-a2de-c38a89991679 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:01.530051 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1c349c7b-de16-4323-a2de-c38a89991679 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:01.536393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c349c7b-de16-4323-a2de-c38a89991679 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:01.537470 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c349c7b-de16-4323-a2de-c38a89991679 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:01.538170 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c349c7b-de16-4323-a2de-c38a89991679 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:01.538858 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c349c7b-de16-4323-a2de-c38a89991679 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:01.539398 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c349c7b-de16-4323-a2de-c38a89991679 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:01.539822 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c349c7b-de16-4323-a2de-c38a89991679 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:01.666870 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1c349c7b-de16-4323-a2de-c38a89991679 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:01.674812 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1c349c7b-de16-4323-a2de-c38a89991679 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:01.676367 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1c349c7b-de16-4323-a2de-c38a89991679 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:01.677552 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1c349c7b-de16-4323-a2de-c38a89991679 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.152068 Aug 08 14:37:01.678165 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 441/912] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:01 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:02.222742 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d0c3649e-ddd6-4fa5-bcb3-0c1bd9ec7feb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:02.223377 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d0c3649e-ddd6-4fa5-bcb3-0c1bd9ec7feb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:02.229674 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d0c3649e-ddd6-4fa5-bcb3-0c1bd9ec7feb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:02.230154 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d0c3649e-ddd6-4fa5-bcb3-0c1bd9ec7feb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:02.230586 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d0c3649e-ddd6-4fa5-bcb3-0c1bd9ec7feb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:02.231314 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d0c3649e-ddd6-4fa5-bcb3-0c1bd9ec7feb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:02.231770 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d0c3649e-ddd6-4fa5-bcb3-0c1bd9ec7feb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:02.232195 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d0c3649e-ddd6-4fa5-bcb3-0c1bd9ec7feb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:02.254965 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d0c3649e-ddd6-4fa5-bcb3-0c1bd9ec7feb tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/ips" status: 200 len: 150 microversion: 2.1 time: 0.036151 Aug 08 14:37:02.256212 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 472/913] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 14:37:02 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:02.700485 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3b4f4e32-67f4-4d0e-8473-6a03e3529048 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:02.701112 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3b4f4e32-67f4-4d0e-8473-6a03e3529048 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:02.707633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b4f4e32-67f4-4d0e-8473-6a03e3529048 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:02.708114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b4f4e32-67f4-4d0e-8473-6a03e3529048 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:02.708572 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b4f4e32-67f4-4d0e-8473-6a03e3529048 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:02.709295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b4f4e32-67f4-4d0e-8473-6a03e3529048 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:02.709745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b4f4e32-67f4-4d0e-8473-6a03e3529048 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:02.710168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b4f4e32-67f4-4d0e-8473-6a03e3529048 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:02.840253 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3b4f4e32-67f4-4d0e-8473-6a03e3529048 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:02.848168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3b4f4e32-67f4-4d0e-8473-6a03e3529048 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:02.850196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3b4f4e32-67f4-4d0e-8473-6a03e3529048 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:02.851365 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3b4f4e32-67f4-4d0e-8473-6a03e3529048 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.154772 Aug 08 14:37:02.851926 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 442/914] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:02 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:03.591328 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5d4a76fb-af3c-4522-b91a-8302fdbc21fe tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8786f359-b096-4665-87e4-d864849a4836"}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:03.593763 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5d4a76fb-af3c-4522-b91a-8302fdbc21fe tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:03.600208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d4a76fb-af3c-4522-b91a-8302fdbc21fe tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:03.600781 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d4a76fb-af3c-4522-b91a-8302fdbc21fe tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:03.601217 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d4a76fb-af3c-4522-b91a-8302fdbc21fe tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:03.601913 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d4a76fb-af3c-4522-b91a-8302fdbc21fe tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:03.602359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d4a76fb-af3c-4522-b91a-8302fdbc21fe tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:03.602780 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d4a76fb-af3c-4522-b91a-8302fdbc21fe tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:03.831771 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5d4a76fb-af3c-4522-b91a-8302fdbc21fe tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "POST /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244188 Aug 08 14:37:03.832398 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 473/915] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 14:37:03 2022] POST /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:03.874322 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a472cb37-3574-4149-a017-bee70f3d6c42 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:03.874925 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a472cb37-3574-4149-a017-bee70f3d6c42 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:03.882710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a472cb37-3574-4149-a017-bee70f3d6c42 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:03.883230 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a472cb37-3574-4149-a017-bee70f3d6c42 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:03.883671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a472cb37-3574-4149-a017-bee70f3d6c42 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:03.884372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a472cb37-3574-4149-a017-bee70f3d6c42 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:03.884826 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a472cb37-3574-4149-a017-bee70f3d6c42 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:03.885252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a472cb37-3574-4149-a017-bee70f3d6c42 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:04.034140 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a472cb37-3574-4149-a017-bee70f3d6c42 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:04.042784 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a472cb37-3574-4149-a017-bee70f3d6c42 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:04.044353 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a472cb37-3574-4149-a017-bee70f3d6c42 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:04.045505 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a472cb37-3574-4149-a017-bee70f3d6c42 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.175042 Aug 08 14:37:04.046083 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 443/916] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:03 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:05.070406 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5d4a6ae6-9a33-4123-be1e-dce1b327efac tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:05.071149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5d4a6ae6-9a33-4123-be1e-dce1b327efac tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:05.077212 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d4a6ae6-9a33-4123-be1e-dce1b327efac tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:05.077685 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d4a6ae6-9a33-4123-be1e-dce1b327efac tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:05.078115 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d4a6ae6-9a33-4123-be1e-dce1b327efac tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:05.078791 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d4a6ae6-9a33-4123-be1e-dce1b327efac tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:05.079271 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d4a6ae6-9a33-4123-be1e-dce1b327efac tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:05.079719 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d4a6ae6-9a33-4123-be1e-dce1b327efac tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:05.208236 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5d4a6ae6-9a33-4123-be1e-dce1b327efac tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:05.216095 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5d4a6ae6-9a33-4123-be1e-dce1b327efac tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:05.217627 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5d4a6ae6-9a33-4123-be1e-dce1b327efac tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:05.218768 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5d4a6ae6-9a33-4123-be1e-dce1b327efac tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.153810 Aug 08 14:37:05.219364 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 474/917] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:05 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:06.240795 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-17ac35a6-567a-4c2c-90ec-025c7ccf7716 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:06.241981 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-17ac35a6-567a-4c2c-90ec-025c7ccf7716 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:06.248440 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17ac35a6-567a-4c2c-90ec-025c7ccf7716 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:06.248922 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17ac35a6-567a-4c2c-90ec-025c7ccf7716 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:06.249363 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17ac35a6-567a-4c2c-90ec-025c7ccf7716 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:06.250051 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17ac35a6-567a-4c2c-90ec-025c7ccf7716 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:06.250502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17ac35a6-567a-4c2c-90ec-025c7ccf7716 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:06.250926 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17ac35a6-567a-4c2c-90ec-025c7ccf7716 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:06.275913 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-05f981cb-9e9f-4ef0-992a-2e300faea2f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:06.276480 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-05f981cb-9e9f-4ef0-992a-2e300faea2f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:06.282991 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-05f981cb-9e9f-4ef0-992a-2e300faea2f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:06.283507 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-05f981cb-9e9f-4ef0-992a-2e300faea2f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:06.284130 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-05f981cb-9e9f-4ef0-992a-2e300faea2f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:06.284822 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-05f981cb-9e9f-4ef0-992a-2e300faea2f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:06.285274 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-05f981cb-9e9f-4ef0-992a-2e300faea2f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:06.285697 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-05f981cb-9e9f-4ef0-992a-2e300faea2f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:06.373259 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-05f981cb-9e9f-4ef0-992a-2e300faea2f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lazy-loading 'services' on Instance uuid 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:37:06.389469 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-17ac35a6-567a-4c2c-90ec-025c7ccf7716 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:06.392087 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:06.399671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-17ac35a6-567a-4c2c-90ec-025c7ccf7716 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:06.401207 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-17ac35a6-567a-4c2c-90ec-025c7ccf7716 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:06.402389 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-17ac35a6-567a-4c2c-90ec-025c7ccf7716 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.165599 Aug 08 14:37:06.402944 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 444/918] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:06 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:06.442333 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-05f981cb-9e9f-4ef0-992a-2e300faea2f7 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments/37786a21-790d-4654-8097-4b348551cb66" status: 202 len: 0 microversion: 2.1 time: 0.170749 Aug 08 14:37:06.442911 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 475/919] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 14:37:06 2022] DELETE /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments/37786a21-790d-4654-8097-4b348551cb66 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 14:37:06.451878 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-03b5200e-1757-4106-925b-9f460a3ae98a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:06.454093 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-03b5200e-1757-4106-925b-9f460a3ae98a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:06.461118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03b5200e-1757-4106-925b-9f460a3ae98a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:06.461803 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03b5200e-1757-4106-925b-9f460a3ae98a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:06.462232 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03b5200e-1757-4106-925b-9f460a3ae98a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:06.462923 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03b5200e-1757-4106-925b-9f460a3ae98a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:06.463421 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03b5200e-1757-4106-925b-9f460a3ae98a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:06.463851 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03b5200e-1757-4106-925b-9f460a3ae98a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:06.494269 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-03b5200e-1757-4106-925b-9f460a3ae98a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046837 Aug 08 14:37:06.494853 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 445/920] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:06 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:07.425536 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f2c6da39-9d9c-4915-b61d-dc0aa46ce066 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:07.426257 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f2c6da39-9d9c-4915-b61d-dc0aa46ce066 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:07.433481 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2c6da39-9d9c-4915-b61d-dc0aa46ce066 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:07.433962 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2c6da39-9d9c-4915-b61d-dc0aa46ce066 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:07.434398 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2c6da39-9d9c-4915-b61d-dc0aa46ce066 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:07.435082 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2c6da39-9d9c-4915-b61d-dc0aa46ce066 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:07.435563 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2c6da39-9d9c-4915-b61d-dc0aa46ce066 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:07.435987 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2c6da39-9d9c-4915-b61d-dc0aa46ce066 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:07.506007 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f2136beb-a9a9-481f-81b3-6c80a9d85d8f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:07.508172 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f2136beb-a9a9-481f-81b3-6c80a9d85d8f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:07.514384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2136beb-a9a9-481f-81b3-6c80a9d85d8f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:07.514857 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2136beb-a9a9-481f-81b3-6c80a9d85d8f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:07.515319 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2136beb-a9a9-481f-81b3-6c80a9d85d8f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:07.516189 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2136beb-a9a9-481f-81b3-6c80a9d85d8f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:07.516442 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2136beb-a9a9-481f-81b3-6c80a9d85d8f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:07.516857 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2136beb-a9a9-481f-81b3-6c80a9d85d8f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:07.552062 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f2136beb-a9a9-481f-81b3-6c80a9d85d8f tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049973 Aug 08 14:37:07.552630 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 446/921] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:07 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:37:07.568583 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f2c6da39-9d9c-4915-b61d-dc0aa46ce066 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:07.577409 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f2c6da39-9d9c-4915-b61d-dc0aa46ce066 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:07.578956 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f2c6da39-9d9c-4915-b61d-dc0aa46ce066 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:07.580157 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f2c6da39-9d9c-4915-b61d-dc0aa46ce066 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.158970 Aug 08 14:37:07.580720 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 476/922] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:07 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:08.564915 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ce0adf1b-76b0-42d6-8a75-d64071aabb18 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:08.567080 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ce0adf1b-76b0-42d6-8a75-d64071aabb18 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:08.574231 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ce0adf1b-76b0-42d6-8a75-d64071aabb18 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:08.574728 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ce0adf1b-76b0-42d6-8a75-d64071aabb18 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:08.575527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ce0adf1b-76b0-42d6-8a75-d64071aabb18 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:08.576121 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ce0adf1b-76b0-42d6-8a75-d64071aabb18 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:08.576572 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ce0adf1b-76b0-42d6-8a75-d64071aabb18 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:08.576994 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ce0adf1b-76b0-42d6-8a75-d64071aabb18 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:08.603080 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-32b0446d-f351-438e-926d-ab6683afeb61 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:08.603712 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-32b0446d-f351-438e-926d-ab6683afeb61 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:08.605161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ce0adf1b-76b0-42d6-8a75-d64071aabb18 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Aug 08 14:37:08.605788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 447/923] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:08 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:08.610087 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-32b0446d-f351-438e-926d-ab6683afeb61 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:08.610570 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-32b0446d-f351-438e-926d-ab6683afeb61 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:08.611002 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-32b0446d-f351-438e-926d-ab6683afeb61 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:08.611723 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-32b0446d-f351-438e-926d-ab6683afeb61 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:08.612178 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-32b0446d-f351-438e-926d-ab6683afeb61 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:08.612601 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-32b0446d-f351-438e-926d-ab6683afeb61 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:08.887848 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-32b0446d-f351-438e-926d-ab6683afeb61 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:08.895657 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-32b0446d-f351-438e-926d-ab6683afeb61 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:08.897184 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-32b0446d-f351-438e-926d-ab6683afeb61 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:08.898358 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-32b0446d-f351-438e-926d-ab6683afeb61 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.299108 Aug 08 14:37:08.898911 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 477/924] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:08 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:09.616926 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-400cd750-4cce-48d5-9000-55cbcadcfd89 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:09.619058 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-400cd750-4cce-48d5-9000-55cbcadcfd89 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:09.625344 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-400cd750-4cce-48d5-9000-55cbcadcfd89 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:09.625820 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-400cd750-4cce-48d5-9000-55cbcadcfd89 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:09.626283 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-400cd750-4cce-48d5-9000-55cbcadcfd89 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:09.626969 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-400cd750-4cce-48d5-9000-55cbcadcfd89 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:09.627449 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-400cd750-4cce-48d5-9000-55cbcadcfd89 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:09.627879 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-400cd750-4cce-48d5-9000-55cbcadcfd89 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:09.656610 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-400cd750-4cce-48d5-9000-55cbcadcfd89 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043681 Aug 08 14:37:09.657166 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 448/925] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:09 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:09.920742 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3e1ca63f-b9b9-4f88-9e49-8f4cde41c7f6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:09.921384 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3e1ca63f-b9b9-4f88-9e49-8f4cde41c7f6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:09.923806 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=44 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:09.928926 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3e1ca63f-b9b9-4f88-9e49-8f4cde41c7f6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:09.929439 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3e1ca63f-b9b9-4f88-9e49-8f4cde41c7f6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:09.929873 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3e1ca63f-b9b9-4f88-9e49-8f4cde41c7f6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:09.930557 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3e1ca63f-b9b9-4f88-9e49-8f4cde41c7f6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:09.931011 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3e1ca63f-b9b9-4f88-9e49-8f4cde41c7f6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:09.931463 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3e1ca63f-b9b9-4f88-9e49-8f4cde41c7f6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:09.935451 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:10.065793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3e1ca63f-b9b9-4f88-9e49-8f4cde41c7f6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:10.074144 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3e1ca63f-b9b9-4f88-9e49-8f4cde41c7f6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:10.075707 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3e1ca63f-b9b9-4f88-9e49-8f4cde41c7f6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:10.076842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3e1ca63f-b9b9-4f88-9e49-8f4cde41c7f6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.160025 Aug 08 14:37:10.077387 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 478/926] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:09 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:10.669444 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-536aec29-1a08-42aa-ad92-7e0fec67e1cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:10.671611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-536aec29-1a08-42aa-ad92-7e0fec67e1cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:10.678025 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-536aec29-1a08-42aa-ad92-7e0fec67e1cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:10.679149 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-536aec29-1a08-42aa-ad92-7e0fec67e1cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:10.679592 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-536aec29-1a08-42aa-ad92-7e0fec67e1cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:10.680282 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-536aec29-1a08-42aa-ad92-7e0fec67e1cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:10.680737 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-536aec29-1a08-42aa-ad92-7e0fec67e1cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:10.681163 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-536aec29-1a08-42aa-ad92-7e0fec67e1cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:10.708956 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-536aec29-1a08-42aa-ad92-7e0fec67e1cc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Aug 08 14:37:10.709432 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 449/927] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:10 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:11.099507 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-74e79d27-dd36-402a-a258-84c22b222775 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:11.100115 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-74e79d27-dd36-402a-a258-84c22b222775 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:11.106956 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-74e79d27-dd36-402a-a258-84c22b222775 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:11.107477 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-74e79d27-dd36-402a-a258-84c22b222775 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:11.107914 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-74e79d27-dd36-402a-a258-84c22b222775 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:11.108603 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-74e79d27-dd36-402a-a258-84c22b222775 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:11.109062 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-74e79d27-dd36-402a-a258-84c22b222775 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:11.109488 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-74e79d27-dd36-402a-a258-84c22b222775 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:11.239963 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-74e79d27-dd36-402a-a258-84c22b222775 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:11.247842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-74e79d27-dd36-402a-a258-84c22b222775 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:11.249380 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-74e79d27-dd36-402a-a258-84c22b222775 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:11.250555 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-74e79d27-dd36-402a-a258-84c22b222775 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.154945 Aug 08 14:37:11.251112 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 479/928] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:11 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:11.348798 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0a79eb3e-38a2-4412-be91-4e8759c266e7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8786f359-b096-4665-87e4-d864849a4836"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:11.351113 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0a79eb3e-38a2-4412-be91-4e8759c266e7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:11.356999 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0a79eb3e-38a2-4412-be91-4e8759c266e7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:11.357480 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0a79eb3e-38a2-4412-be91-4e8759c266e7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:11.357920 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0a79eb3e-38a2-4412-be91-4e8759c266e7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:11.358664 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0a79eb3e-38a2-4412-be91-4e8759c266e7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:11.359158 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0a79eb3e-38a2-4412-be91-4e8759c266e7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:11.359586 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0a79eb3e-38a2-4412-be91-4e8759c266e7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:11.435773 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-0a79eb3e-38a2-4412-be91-4e8759c266e7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] HTTP exception thrown: Invalid volume: volume 8786f359-b096-4665-87e4-d864849a4836 is already attached to instances: ba51345a-39b0-42ed-b0af-bff1e07fd698 Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0a79eb3e-38a2-4412-be91-4e8759c266e7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Request method failure captured: Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: POST /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments HTTP/1.1 Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 74 Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4nDHzBnzio2VZ6ciHSRMNEEHFIYRjyMTvKRDfIH2F_niI0FcU0ZqBeBBZkKpUdHOb90TorX284g0qMdisJyL77Y3j06R-x49-mqWZufa0BFWwlg29tIQoalg1p609ZLEly-KDP4mLoxCO4eWlqZVpPuU5-IPf0H50niq4AklVZ208 Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:37:11.437530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:37:11.439138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc86120e53145328dd430f542e73182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc86120e53145328dd430f542e73182", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}] Aug 08 14:37:11.439138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:37:11.439138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:37:11.439138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:37:11.439138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:37:11.439138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:37:11.439138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:37:11.439138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 48a91f6797cc4604ba2606e0549234d0 Aug 08 14:37:11.439138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:37:11.439138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Aug 08 14:37:11.439138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {"volumeAttachment": {"volumeId": "8786f359-b096-4665-87e4-d864849a4836"}} Aug 08 14:37:11.439138 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Invalid volume: volume 8786f359-b096-4665-87e4-d864849a4836 is already attached to instances: ba51345a-39b0-42ed-b0af-bff1e07fd698 Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'server_id': 'ba51345a-39b0-42ed-b0af-bff1e07fd698', 'body': {'volumeAttachment': {'volumeId': '8786f359-b096-4665-87e4-d864849a4836'}}} Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8786f359-b096-4665-87e4-d864849a4836 is already attached to instances: ba51345a-39b0-42ed-b0af-bff1e07fd698 Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:11.440201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8786f359-b096-4665-87e4-d864849a4836 is already attached to instances: ba51345a-39b0-42ed-b0af-bff1e07fd698 Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:11.441642 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:11.443365 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:11.443365 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:37:11.443365 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:37:11.443365 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8786f359-b096-4665-87e4-d864849a4836 is already attached to instances: ba51345a-39b0-42ed-b0af-bff1e07fd698 Aug 08 14:37:11.443365 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:11.443365 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0a79eb3e-38a2-4412-be91-4e8759c266e7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Returning 400 to user: Invalid volume: volume 8786f359-b096-4665-87e4-d864849a4836 is already attached to instances: ba51345a-39b0-42ed-b0af-bff1e07fd698 {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:37:11.443365 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0a79eb3e-38a2-4412-be91-4e8759c266e7 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "POST /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094340 Aug 08 14:37:11.443365 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 450/929] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 14:37:11 2022] POST /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 14:37:11.501673 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5fcaa094-38da-40f6-acb4-afcba50059a1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:11.502103 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5fcaa094-38da-40f6-acb4-afcba50059a1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:11.508664 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5fcaa094-38da-40f6-acb4-afcba50059a1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:11.509150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5fcaa094-38da-40f6-acb4-afcba50059a1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:11.509584 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5fcaa094-38da-40f6-acb4-afcba50059a1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:11.510273 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5fcaa094-38da-40f6-acb4-afcba50059a1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:11.510726 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5fcaa094-38da-40f6-acb4-afcba50059a1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:11.511186 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5fcaa094-38da-40f6-acb4-afcba50059a1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:11.588797 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-5fcaa094-38da-40f6-acb4-afcba50059a1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lazy-loading 'services' on Instance uuid ba51345a-39b0-42ed-b0af-bff1e07fd698 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:37:11.657051 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5fcaa094-38da-40f6-acb4-afcba50059a1 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments/8786f359-b096-4665-87e4-d864849a4836" status: 202 len: 0 microversion: 2.1 time: 0.159139 Aug 08 14:37:11.657797 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 480/930] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 14:37:11 2022] DELETE /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments/8786f359-b096-4665-87e4-d864849a4836 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:37:11.666279 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-244883e7-b216-41e1-93ba-2b1251e249c3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:11.668535 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-244883e7-b216-41e1-93ba-2b1251e249c3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:11.674442 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-244883e7-b216-41e1-93ba-2b1251e249c3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:11.675132 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-244883e7-b216-41e1-93ba-2b1251e249c3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:11.675434 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-244883e7-b216-41e1-93ba-2b1251e249c3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:11.676061 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-244883e7-b216-41e1-93ba-2b1251e249c3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:11.676513 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-244883e7-b216-41e1-93ba-2b1251e249c3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:11.676936 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-244883e7-b216-41e1-93ba-2b1251e249c3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:11.709419 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-244883e7-b216-41e1-93ba-2b1251e249c3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047264 Aug 08 14:37:11.710010 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 451/931] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:11 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:11.721535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1391ab7d-8e88-4f63-ae5c-56954b241954 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:11.723913 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1391ab7d-8e88-4f63-ae5c-56954b241954 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:11.730365 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1391ab7d-8e88-4f63-ae5c-56954b241954 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:11.730849 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1391ab7d-8e88-4f63-ae5c-56954b241954 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:11.731405 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1391ab7d-8e88-4f63-ae5c-56954b241954 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:11.731996 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1391ab7d-8e88-4f63-ae5c-56954b241954 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:11.732457 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1391ab7d-8e88-4f63-ae5c-56954b241954 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:11.732884 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1391ab7d-8e88-4f63-ae5c-56954b241954 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:11.763456 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1391ab7d-8e88-4f63-ae5c-56954b241954 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046251 Aug 08 14:37:11.764068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 481/932] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:11 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 14:37:11.836280 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2931f6be-28b1-4167-955d-9b96d51f0e7d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:11.836773 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2931f6be-28b1-4167-955d-9b96d51f0e7d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:11.842644 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2931f6be-28b1-4167-955d-9b96d51f0e7d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:11.843150 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2931f6be-28b1-4167-955d-9b96d51f0e7d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:11.843593 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2931f6be-28b1-4167-955d-9b96d51f0e7d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:11.844312 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2931f6be-28b1-4167-955d-9b96d51f0e7d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:11.844764 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2931f6be-28b1-4167-955d-9b96d51f0e7d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:11.845187 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2931f6be-28b1-4167-955d-9b96d51f0e7d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:12.020317 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2931f6be-28b1-4167-955d-9b96d51f0e7d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:37:12.090067 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2931f6be-28b1-4167-955d-9b96d51f0e7d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 204 len: 0 microversion: 2.1 time: 0.257434 Aug 08 14:37:12.090619 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 452/933] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:37:11 2022] DELETE /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 14:37:12.098763 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-22c2cf35-a131-4939-94ec-f89d717ab2c1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:12.099457 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-22c2cf35-a131-4939-94ec-f89d717ab2c1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:12.106237 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22c2cf35-a131-4939-94ec-f89d717ab2c1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:12.106821 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22c2cf35-a131-4939-94ec-f89d717ab2c1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:12.107210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22c2cf35-a131-4939-94ec-f89d717ab2c1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:12.107913 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22c2cf35-a131-4939-94ec-f89d717ab2c1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:12.108374 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22c2cf35-a131-4939-94ec-f89d717ab2c1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:12.108804 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-22c2cf35-a131-4939-94ec-f89d717ab2c1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:12.242164 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-22c2cf35-a131-4939-94ec-f89d717ab2c1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:12.249538 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-22c2cf35-a131-4939-94ec-f89d717ab2c1 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1691 microversion: 2.1 time: 0.154860 Aug 08 14:37:12.250094 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 482/934] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:12 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:12.275790 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6bf706b9-36ed-4b9b-8bad-c429bb4b63d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:12.276415 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6bf706b9-36ed-4b9b-8bad-c429bb4b63d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:12.282179 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6bf706b9-36ed-4b9b-8bad-c429bb4b63d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:12.282653 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6bf706b9-36ed-4b9b-8bad-c429bb4b63d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:12.283084 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6bf706b9-36ed-4b9b-8bad-c429bb4b63d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:12.283789 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6bf706b9-36ed-4b9b-8bad-c429bb4b63d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:12.284239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6bf706b9-36ed-4b9b-8bad-c429bb4b63d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:12.284660 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6bf706b9-36ed-4b9b-8bad-c429bb4b63d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:12.417654 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6bf706b9-36ed-4b9b-8bad-c429bb4b63d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:12.425506 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6bf706b9-36ed-4b9b-8bad-c429bb4b63d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:12.427044 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6bf706b9-36ed-4b9b-8bad-c429bb4b63d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:12.428218 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6bf706b9-36ed-4b9b-8bad-c429bb4b63d9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.157212 Aug 08 14:37:12.428771 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 453/935] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:12 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:12.608621 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-79d93adb-a66d-4c1e-8ef2-693f94db0512 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:12.609160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-79d93adb-a66d-4c1e-8ef2-693f94db0512 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:12.615029 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-79d93adb-a66d-4c1e-8ef2-693f94db0512 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:12.615546 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-79d93adb-a66d-4c1e-8ef2-693f94db0512 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:12.615989 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-79d93adb-a66d-4c1e-8ef2-693f94db0512 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:12.616677 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-79d93adb-a66d-4c1e-8ef2-693f94db0512 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:12.617131 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-79d93adb-a66d-4c1e-8ef2-693f94db0512 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:12.617554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-79d93adb-a66d-4c1e-8ef2-693f94db0512 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:12.641161 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-79d93adb-a66d-4c1e-8ef2-693f94db0512 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lazy-loading 'flavor' on Instance uuid 0eff17af-e081-4582-82fb-ba2f7a45c338 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:37:12.711774 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-79d93adb-a66d-4c1e-8ef2-693f94db0512 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "POST /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338/action" status: 202 len: 0 microversion: 2.1 time: 0.106953 Aug 08 14:37:12.712380 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 483/936] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 14:37:12 2022] POST /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:37:12.720759 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-28f02123-4dda-421b-8a49-6b418673e834 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:12.721540 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-28f02123-4dda-421b-8a49-6b418673e834 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:12.722520 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d4f6f0a9-d610-453d-b791-7071e77b1810 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:12.725015 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d4f6f0a9-d610-453d-b791-7071e77b1810 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:12.729731 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28f02123-4dda-421b-8a49-6b418673e834 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:12.730222 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28f02123-4dda-421b-8a49-6b418673e834 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:12.730660 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28f02123-4dda-421b-8a49-6b418673e834 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:12.731407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28f02123-4dda-421b-8a49-6b418673e834 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:12.731870 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28f02123-4dda-421b-8a49-6b418673e834 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:12.732066 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4f6f0a9-d610-453d-b791-7071e77b1810 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:12.732293 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28f02123-4dda-421b-8a49-6b418673e834 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:12.732559 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4f6f0a9-d610-453d-b791-7071e77b1810 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:12.733000 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4f6f0a9-d610-453d-b791-7071e77b1810 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:12.733725 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4f6f0a9-d610-453d-b791-7071e77b1810 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:12.734188 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4f6f0a9-d610-453d-b791-7071e77b1810 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:12.734620 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d4f6f0a9-d610-453d-b791-7071e77b1810 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:12.767482 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d4f6f0a9-d610-453d-b791-7071e77b1810 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049478 Aug 08 14:37:12.772025 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 484/937] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:12 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:37:12.875584 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-28f02123-4dda-421b-8a49-6b418673e834 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:12.883671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-28f02123-4dda-421b-8a49-6b418673e834 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.167040 Aug 08 14:37:12.884233 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 454/938] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:12 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:13.269632 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6fc65272-df3f-4632-b1ce-16f9b4ad4f59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:13.270243 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6fc65272-df3f-4632-b1ce-16f9b4ad4f59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:13.276655 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6fc65272-df3f-4632-b1ce-16f9b4ad4f59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:13.277138 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6fc65272-df3f-4632-b1ce-16f9b4ad4f59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:13.277575 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6fc65272-df3f-4632-b1ce-16f9b4ad4f59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:13.278263 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6fc65272-df3f-4632-b1ce-16f9b4ad4f59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:13.278715 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6fc65272-df3f-4632-b1ce-16f9b4ad4f59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:13.279248 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6fc65272-df3f-4632-b1ce-16f9b4ad4f59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:13.405217 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-6fc65272-df3f-4632-b1ce-16f9b4ad4f59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:13.413359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6fc65272-df3f-4632-b1ce-16f9b4ad4f59 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1691 microversion: 2.1 time: 0.146880 Aug 08 14:37:13.413923 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 485/939] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:13 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:13.450606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4163f489-9472-492f-ada1-9fd592fd6972 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:13.451235 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4163f489-9472-492f-ada1-9fd592fd6972 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:13.457066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4163f489-9472-492f-ada1-9fd592fd6972 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:13.457545 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4163f489-9472-492f-ada1-9fd592fd6972 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:13.457970 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4163f489-9472-492f-ada1-9fd592fd6972 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:13.458649 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4163f489-9472-492f-ada1-9fd592fd6972 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:13.459111 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4163f489-9472-492f-ada1-9fd592fd6972 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:13.459565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4163f489-9472-492f-ada1-9fd592fd6972 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:13.588055 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4163f489-9472-492f-ada1-9fd592fd6972 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:13.595924 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4163f489-9472-492f-ada1-9fd592fd6972 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:13.597475 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4163f489-9472-492f-ada1-9fd592fd6972 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:13.598724 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4163f489-9472-492f-ada1-9fd592fd6972 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.151870 Aug 08 14:37:13.599309 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 455/940] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:13 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:13.779665 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8ff091e5-037a-47ab-91eb-f460cf46eca5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:13.781823 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8ff091e5-037a-47ab-91eb-f460cf46eca5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:13.788582 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ff091e5-037a-47ab-91eb-f460cf46eca5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:13.789002 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ff091e5-037a-47ab-91eb-f460cf46eca5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:13.789433 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ff091e5-037a-47ab-91eb-f460cf46eca5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:13.790118 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ff091e5-037a-47ab-91eb-f460cf46eca5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:13.790573 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ff091e5-037a-47ab-91eb-f460cf46eca5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:13.790997 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8ff091e5-037a-47ab-91eb-f460cf46eca5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:13.818486 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8ff091e5-037a-47ab-91eb-f460cf46eca5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042834 Aug 08 14:37:13.819003 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 486/941] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:13 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:13.904155 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d82b367a-40f9-4b43-af31-795a824eb45c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:13.904802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d82b367a-40f9-4b43-af31-795a824eb45c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:13.911156 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d82b367a-40f9-4b43-af31-795a824eb45c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:13.911638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d82b367a-40f9-4b43-af31-795a824eb45c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:13.912107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d82b367a-40f9-4b43-af31-795a824eb45c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:13.913664 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d82b367a-40f9-4b43-af31-795a824eb45c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:13.914119 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d82b367a-40f9-4b43-af31-795a824eb45c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:13.914542 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d82b367a-40f9-4b43-af31-795a824eb45c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:14.044920 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d82b367a-40f9-4b43-af31-795a824eb45c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:14.052309 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d82b367a-40f9-4b43-af31-795a824eb45c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.151993 Aug 08 14:37:14.052863 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 456/942] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:13 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:14.434019 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c6db20fa-d034-4c8c-9f93-366af5d48ee2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:14.434652 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c6db20fa-d034-4c8c-9f93-366af5d48ee2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:14.440912 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6db20fa-d034-4c8c-9f93-366af5d48ee2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:14.441387 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6db20fa-d034-4c8c-9f93-366af5d48ee2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:14.441819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6db20fa-d034-4c8c-9f93-366af5d48ee2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:14.442508 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6db20fa-d034-4c8c-9f93-366af5d48ee2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:14.442959 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6db20fa-d034-4c8c-9f93-366af5d48ee2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:14.443404 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c6db20fa-d034-4c8c-9f93-366af5d48ee2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:14.572332 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c6db20fa-d034-4c8c-9f93-366af5d48ee2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:14.580664 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c6db20fa-d034-4c8c-9f93-366af5d48ee2 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1691 microversion: 2.1 time: 0.150461 Aug 08 14:37:14.581226 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 487/943] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:14 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:14.622164 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4c9e029e-4b5b-43ef-842a-771670502cd8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:14.622792 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4c9e029e-4b5b-43ef-842a-771670502cd8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:14.628617 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c9e029e-4b5b-43ef-842a-771670502cd8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:14.629089 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c9e029e-4b5b-43ef-842a-771670502cd8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:14.629543 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c9e029e-4b5b-43ef-842a-771670502cd8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:14.630224 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c9e029e-4b5b-43ef-842a-771670502cd8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:14.630671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c9e029e-4b5b-43ef-842a-771670502cd8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:14.631110 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c9e029e-4b5b-43ef-842a-771670502cd8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:14.762141 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4c9e029e-4b5b-43ef-842a-771670502cd8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:14.769879 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4c9e029e-4b5b-43ef-842a-771670502cd8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:14.771417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4c9e029e-4b5b-43ef-842a-771670502cd8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:14.772560 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4c9e029e-4b5b-43ef-842a-771670502cd8 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.154271 Aug 08 14:37:14.773104 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 457/944] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:14 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:14.831051 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9b9404f3-946b-4816-a800-342dea734a3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:14.833247 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9b9404f3-946b-4816-a800-342dea734a3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:14.839234 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9b9404f3-946b-4816-a800-342dea734a3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:14.839720 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9b9404f3-946b-4816-a800-342dea734a3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:14.840159 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9b9404f3-946b-4816-a800-342dea734a3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:14.840855 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9b9404f3-946b-4816-a800-342dea734a3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:14.841312 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9b9404f3-946b-4816-a800-342dea734a3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:14.841742 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9b9404f3-946b-4816-a800-342dea734a3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:14.870523 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9b9404f3-946b-4816-a800-342dea734a3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043470 Aug 08 14:37:14.871065 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 488/945] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:14 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:15.072954 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2a53e88b-35c3-4b8a-b349-622116a7178d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:15.073589 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2a53e88b-35c3-4b8a-b349-622116a7178d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:15.079885 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a53e88b-35c3-4b8a-b349-622116a7178d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:15.080360 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a53e88b-35c3-4b8a-b349-622116a7178d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:15.080788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a53e88b-35c3-4b8a-b349-622116a7178d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:15.081472 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a53e88b-35c3-4b8a-b349-622116a7178d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:15.081918 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a53e88b-35c3-4b8a-b349-622116a7178d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:15.082334 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a53e88b-35c3-4b8a-b349-622116a7178d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:15.208945 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2a53e88b-35c3-4b8a-b349-622116a7178d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:15.216399 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2a53e88b-35c3-4b8a-b349-622116a7178d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.147297 Aug 08 14:37:15.216948 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 458/946] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:15 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:15.602248 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-278dcad8-9b01-44f3-8c5e-2f7528daba14 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:15.602864 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-278dcad8-9b01-44f3-8c5e-2f7528daba14 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:15.609416 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-278dcad8-9b01-44f3-8c5e-2f7528daba14 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:15.609899 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-278dcad8-9b01-44f3-8c5e-2f7528daba14 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:15.610339 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-278dcad8-9b01-44f3-8c5e-2f7528daba14 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:15.611030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-278dcad8-9b01-44f3-8c5e-2f7528daba14 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:15.611512 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-278dcad8-9b01-44f3-8c5e-2f7528daba14 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:15.611939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-278dcad8-9b01-44f3-8c5e-2f7528daba14 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:15.744065 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-278dcad8-9b01-44f3-8c5e-2f7528daba14 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:15.751521 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-278dcad8-9b01-44f3-8c5e-2f7528daba14 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1691 microversion: 2.1 time: 0.153844 Aug 08 14:37:15.752462 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 489/947] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:15 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:15.795465 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-14b13241-8194-4a2b-a0a1-54b703e3c83d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:15.796104 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-14b13241-8194-4a2b-a0a1-54b703e3c83d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:15.802312 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-14b13241-8194-4a2b-a0a1-54b703e3c83d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:15.802788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-14b13241-8194-4a2b-a0a1-54b703e3c83d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:15.803248 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-14b13241-8194-4a2b-a0a1-54b703e3c83d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:15.803920 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-14b13241-8194-4a2b-a0a1-54b703e3c83d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:15.804371 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-14b13241-8194-4a2b-a0a1-54b703e3c83d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:15.804788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-14b13241-8194-4a2b-a0a1-54b703e3c83d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:15.882536 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ca556ff5-9b55-4248-aade-9b4c3063b08f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:15.884751 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ca556ff5-9b55-4248-aade-9b4c3063b08f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:15.890978 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ca556ff5-9b55-4248-aade-9b4c3063b08f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:15.891492 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ca556ff5-9b55-4248-aade-9b4c3063b08f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:15.891926 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ca556ff5-9b55-4248-aade-9b4c3063b08f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:15.892622 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ca556ff5-9b55-4248-aade-9b4c3063b08f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:15.893074 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ca556ff5-9b55-4248-aade-9b4c3063b08f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:15.895125 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ca556ff5-9b55-4248-aade-9b4c3063b08f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:15.931954 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ca556ff5-9b55-4248-aade-9b4c3063b08f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053814 Aug 08 14:37:15.932712 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 490/948] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:15 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:37:15.945477 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-14b13241-8194-4a2b-a0a1-54b703e3c83d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:15.947812 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:15.954567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-14b13241-8194-4a2b-a0a1-54b703e3c83d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:15.956133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-14b13241-8194-4a2b-a0a1-54b703e3c83d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:15.957289 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-14b13241-8194-4a2b-a0a1-54b703e3c83d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1744 microversion: 2.20 time: 0.165882 Aug 08 14:37:15.957836 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 459/949] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:15 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:16.237743 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-acfba6d7-8a0f-412d-af6a-a458298bd147 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:16.238475 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-acfba6d7-8a0f-412d-af6a-a458298bd147 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:16.245476 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-acfba6d7-8a0f-412d-af6a-a458298bd147 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:16.246275 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-acfba6d7-8a0f-412d-af6a-a458298bd147 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:16.246780 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-acfba6d7-8a0f-412d-af6a-a458298bd147 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:16.247581 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-acfba6d7-8a0f-412d-af6a-a458298bd147 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:16.248133 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-acfba6d7-8a0f-412d-af6a-a458298bd147 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:16.248625 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-acfba6d7-8a0f-412d-af6a-a458298bd147 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:16.392408 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-acfba6d7-8a0f-412d-af6a-a458298bd147 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:16.400426 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-acfba6d7-8a0f-412d-af6a-a458298bd147 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.166595 Aug 08 14:37:16.400983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 491/950] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:16 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:16.774380 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-39cf3eaa-7177-4cf5-990e-470783de52ef tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:16.774988 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-39cf3eaa-7177-4cf5-990e-470783de52ef tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:16.783226 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-39cf3eaa-7177-4cf5-990e-470783de52ef tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:16.783768 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-39cf3eaa-7177-4cf5-990e-470783de52ef tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:16.784186 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-39cf3eaa-7177-4cf5-990e-470783de52ef tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:16.784905 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-39cf3eaa-7177-4cf5-990e-470783de52ef tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:16.785359 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-39cf3eaa-7177-4cf5-990e-470783de52ef tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:16.785781 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-39cf3eaa-7177-4cf5-990e-470783de52ef tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:16.805354 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-8344e324-28ce-4abd-acd5-f071e4e609c4 req-9231bc5f-3898-4b14-8ce8-008792c4dcfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8", "name": "network-vif-deleted", "tag": "ecab4c77-001d-40fa-84b2-143d50377acf"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:16.818708 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-8344e324-28ce-4abd-acd5-f071e4e609c4 req-9231bc5f-3898-4b14-8ce8-008792c4dcfb service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:16.819571 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-8344e324-28ce-4abd-acd5-f071e4e609c4 req-9231bc5f-3898-4b14-8ce8-008792c4dcfb service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:16.820248 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-8344e324-28ce-4abd-acd5-f071e4e609c4 req-9231bc5f-3898-4b14-8ce8-008792c4dcfb service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:16.824583 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:16.837075 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-8344e324-28ce-4abd-acd5-f071e4e609c4 req-9231bc5f-3898-4b14-8ce8-008792c4dcfb service nova] Creating event network-vif-deleted:ecab4c77-001d-40fa-84b2-143d50377acf for instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 on hv-cinder-85200 Aug 08 14:37:16.842710 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-8344e324-28ce-4abd-acd5-f071e4e609c4 req-9231bc5f-3898-4b14-8ce8-008792c4dcfb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046065 Aug 08 14:37:16.844930 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 492/951] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:16.858175 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-39cf3eaa-7177-4cf5-990e-470783de52ef tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:16.866743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-39cf3eaa-7177-4cf5-990e-470783de52ef tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1623 microversion: 2.1 time: 0.096689 Aug 08 14:37:16.867351 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 460/952] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:16 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1623 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:16.946148 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2a97d6bf-559c-4d71-a029-432c92df7fde tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:16.948921 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2a97d6bf-559c-4d71-a029-432c92df7fde tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:16.960216 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2a97d6bf-559c-4d71-a029-432c92df7fde tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:16.960775 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2a97d6bf-559c-4d71-a029-432c92df7fde tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:16.962973 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2a97d6bf-559c-4d71-a029-432c92df7fde tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:16.963895 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2a97d6bf-559c-4d71-a029-432c92df7fde tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:16.964361 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2a97d6bf-559c-4d71-a029-432c92df7fde tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:16.964853 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2a97d6bf-559c-4d71-a029-432c92df7fde tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:16.981638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9edd6d92-c7b8-42bf-8246-cd6927702f31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:16.982764 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9edd6d92-c7b8-42bf-8246-cd6927702f31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:16.991495 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9edd6d92-c7b8-42bf-8246-cd6927702f31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:16.992551 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9edd6d92-c7b8-42bf-8246-cd6927702f31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:16.993217 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9edd6d92-c7b8-42bf-8246-cd6927702f31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:16.994180 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9edd6d92-c7b8-42bf-8246-cd6927702f31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:16.994894 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9edd6d92-c7b8-42bf-8246-cd6927702f31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:16.995641 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9edd6d92-c7b8-42bf-8246-cd6927702f31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:17.004140 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2a97d6bf-559c-4d71-a029-432c92df7fde tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062889 Aug 08 14:37:17.005199 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 493/953] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:16 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 14:37:17.081588 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-cae89a0b-3432-402b-8534-ce5231d5fae4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:17.082166 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-cae89a0b-3432-402b-8534-ce5231d5fae4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:17.089598 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cae89a0b-3432-402b-8534-ce5231d5fae4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:17.090359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cae89a0b-3432-402b-8534-ce5231d5fae4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:17.090803 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cae89a0b-3432-402b-8534-ce5231d5fae4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:17.091648 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cae89a0b-3432-402b-8534-ce5231d5fae4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:17.092084 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cae89a0b-3432-402b-8534-ce5231d5fae4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:17.092483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cae89a0b-3432-402b-8534-ce5231d5fae4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:17.118546 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-cae89a0b-3432-402b-8534-ce5231d5fae4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Going to try to terminate instance {{(pid=118062) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:37:17.152995 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9edd6d92-c7b8-42bf-8246-cd6927702f31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:17.162723 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9edd6d92-c7b8-42bf-8246-cd6927702f31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:17.164326 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9edd6d92-c7b8-42bf-8246-cd6927702f31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:17.165493 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9edd6d92-c7b8-42bf-8246-cd6927702f31 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1744 microversion: 2.20 time: 0.188002 Aug 08 14:37:17.166241 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 461/954] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:16 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:17.201175 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-cae89a0b-3432-402b-8534-ce5231d5fae4 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 204 len: 0 microversion: 2.1 time: 0.123142 Aug 08 14:37:17.201755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 494/955] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:37:17 2022] DELETE /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 14:37:17.210427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5f5ca502-1727-4bbc-858a-7430b52fce4e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:17.211252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5f5ca502-1727-4bbc-858a-7430b52fce4e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:17.214145 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:17.218203 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f5ca502-1727-4bbc-858a-7430b52fce4e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:17.218693 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f5ca502-1727-4bbc-858a-7430b52fce4e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:17.219155 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f5ca502-1727-4bbc-858a-7430b52fce4e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:17.219856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f5ca502-1727-4bbc-858a-7430b52fce4e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:17.220316 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f5ca502-1727-4bbc-858a-7430b52fce4e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:17.220741 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f5ca502-1727-4bbc-858a-7430b52fce4e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:17.359810 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5f5ca502-1727-4bbc-858a-7430b52fce4e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:17.367399 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5f5ca502-1727-4bbc-858a-7430b52fce4e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1682 microversion: 2.1 time: 0.161282 Aug 08 14:37:17.367980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 462/956] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:17 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:17.422456 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7d09206f-289c-4b0e-814b-75a2ee45bdf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:17.423185 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7d09206f-289c-4b0e-814b-75a2ee45bdf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:17.429070 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d09206f-289c-4b0e-814b-75a2ee45bdf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:17.429555 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d09206f-289c-4b0e-814b-75a2ee45bdf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:17.429992 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d09206f-289c-4b0e-814b-75a2ee45bdf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:17.430685 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d09206f-289c-4b0e-814b-75a2ee45bdf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:17.431191 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d09206f-289c-4b0e-814b-75a2ee45bdf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:17.431617 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d09206f-289c-4b0e-814b-75a2ee45bdf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:17.580404 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7d09206f-289c-4b0e-814b-75a2ee45bdf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:17.588238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7d09206f-289c-4b0e-814b-75a2ee45bdf2 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.170087 Aug 08 14:37:17.588899 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 495/957] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:17 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:17.888468 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-aa48519f-9ead-4eae-ae6f-693db4e3f0b5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:17.889114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-aa48519f-9ead-4eae-ae6f-693db4e3f0b5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:17.895632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa48519f-9ead-4eae-ae6f-693db4e3f0b5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:17.896102 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa48519f-9ead-4eae-ae6f-693db4e3f0b5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:17.896583 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa48519f-9ead-4eae-ae6f-693db4e3f0b5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:17.897658 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa48519f-9ead-4eae-ae6f-693db4e3f0b5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:17.898123 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa48519f-9ead-4eae-ae6f-693db4e3f0b5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:17.898555 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa48519f-9ead-4eae-ae6f-693db4e3f0b5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:17.930597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa48519f-9ead-4eae-ae6f-693db4e3f0b5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:17.931079 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa48519f-9ead-4eae-ae6f-693db4e3f0b5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:17.931542 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa48519f-9ead-4eae-ae6f-693db4e3f0b5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:17.931989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-aa48519f-9ead-4eae-ae6f-693db4e3f0b5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lazy-loading 'fault' on Instance uuid 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:37:17.972671 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-aa48519f-9ead-4eae-ae6f-693db4e3f0b5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:17.981475 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-aa48519f-9ead-4eae-ae6f-693db4e3f0b5 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 200 len: 1336 microversion: 2.1 time: 0.096968 Aug 08 14:37:17.982053 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 463/958] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:17 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 1336 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:18.189471 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9c9c8aa1-6fc9-4965-bee8-da2762827ee6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:18.190071 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9c9c8aa1-6fc9-4965-bee8-da2762827ee6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:18.196662 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9c9c8aa1-6fc9-4965-bee8-da2762827ee6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:18.197141 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9c9c8aa1-6fc9-4965-bee8-da2762827ee6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:18.197569 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9c9c8aa1-6fc9-4965-bee8-da2762827ee6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:18.198262 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9c9c8aa1-6fc9-4965-bee8-da2762827ee6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:18.198713 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9c9c8aa1-6fc9-4965-bee8-da2762827ee6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:18.199189 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9c9c8aa1-6fc9-4965-bee8-da2762827ee6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:18.329900 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9c9c8aa1-6fc9-4965-bee8-da2762827ee6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:18.338341 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9c9c8aa1-6fc9-4965-bee8-da2762827ee6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:18.339897 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9c9c8aa1-6fc9-4965-bee8-da2762827ee6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:18.341047 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9c9c8aa1-6fc9-4965-bee8-da2762827ee6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1744 microversion: 2.20 time: 0.155516 Aug 08 14:37:18.341606 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 496/959] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:18 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:18.388558 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3fb9d549-04b3-4c30-ae2d-d6fe2ae2ef52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:18.389101 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3fb9d549-04b3-4c30-ae2d-d6fe2ae2ef52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:18.394945 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3fb9d549-04b3-4c30-ae2d-d6fe2ae2ef52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:18.395468 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3fb9d549-04b3-4c30-ae2d-d6fe2ae2ef52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:18.395901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3fb9d549-04b3-4c30-ae2d-d6fe2ae2ef52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:18.396586 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3fb9d549-04b3-4c30-ae2d-d6fe2ae2ef52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:18.397538 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3fb9d549-04b3-4c30-ae2d-d6fe2ae2ef52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:18.397959 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3fb9d549-04b3-4c30-ae2d-d6fe2ae2ef52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:18.528247 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3fb9d549-04b3-4c30-ae2d-d6fe2ae2ef52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:18.535665 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3fb9d549-04b3-4c30-ae2d-d6fe2ae2ef52 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1682 microversion: 2.1 time: 0.151190 Aug 08 14:37:18.536225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 464/960] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:18 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:18.609935 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7343d40c-7845-4d65-abb3-a4470e01e00e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:18.610546 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7343d40c-7845-4d65-abb3-a4470e01e00e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:18.616478 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7343d40c-7845-4d65-abb3-a4470e01e00e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:18.616957 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7343d40c-7845-4d65-abb3-a4470e01e00e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:18.617385 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7343d40c-7845-4d65-abb3-a4470e01e00e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:18.618065 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7343d40c-7845-4d65-abb3-a4470e01e00e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:18.618515 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7343d40c-7845-4d65-abb3-a4470e01e00e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:18.618938 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7343d40c-7845-4d65-abb3-a4470e01e00e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:18.746984 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7343d40c-7845-4d65-abb3-a4470e01e00e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:18.754407 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7343d40c-7845-4d65-abb3-a4470e01e00e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.148483 Aug 08 14:37:18.754972 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 497/961] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:18 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:19.001844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0af94e24-05a7-4ca3-9e49-002c511f6e4d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:19.002383 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0af94e24-05a7-4ca3-9e49-002c511f6e4d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:19.008935 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0af94e24-05a7-4ca3-9e49-002c511f6e4d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:19.009418 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0af94e24-05a7-4ca3-9e49-002c511f6e4d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:19.009848 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0af94e24-05a7-4ca3-9e49-002c511f6e4d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:19.010537 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0af94e24-05a7-4ca3-9e49-002c511f6e4d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:19.011046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0af94e24-05a7-4ca3-9e49-002c511f6e4d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:19.011544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0af94e24-05a7-4ca3-9e49-002c511f6e4d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:19.024827 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-0af94e24-05a7-4ca3-9e49-002c511f6e4d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] HTTP exception thrown: Instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 could not be found. Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0af94e24-05a7-4ca3-9e49-002c511f6e4d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Request method failure captured: Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 HTTP/1.1 Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R57J81LntT0wnBLoq0gsHuTcdb_gHa2boWqNwcHJNT7GzMY0xQaN4u9gbPeQMkc14SBA7jeP_d07iW79RHlaNziPk2GWGa1BYt-GMeY3VrGnZvm8TtxiX0dmqfpjGqGooMq0e11KFxasfjzOL609Nmftln0YBM8XLy3f2h8GasueEo Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 6ecb83fbcae94dca82331ab87f028878 Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:37:19.026461 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:37:19.028096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6ecb83fbcae94dca82331ab87f028878"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6ecb83fbcae94dca82331ab87f028878", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ecb83fbcae94dca82331ab87f028878"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ecb83fbcae94dca82331ab87f028878"}]}] Aug 08 14:37:19.028096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:37:19.028096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 6ecb83fbcae94dca82331ab87f028878 Aug 08 14:37:19.028096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:37:19.028096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-ServerRescueNegativeTestJSON-1730375856-project Aug 08 14:37:19.028096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:37:19.028096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:37:19.028096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 7d373dfa8c474ade92e94dc73dd9926f Aug 08 14:37:19.028096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1730375856-project Aug 08 14:37:19.028096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:37:19.028096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 could not be found. Aug 08 14:37:19.028096 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8'} Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 could not be found. Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:37:19.029114 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 could not be found. Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 could not be found. Aug 08 14:37:19.030634 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:19.032005 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0af94e24-05a7-4ca3-9e49-002c511f6e4d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Returning 404 to user: Instance 1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:37:19.032005 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0af94e24-05a7-4ca3-9e49-002c511f6e4d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8" status: 404 len: 111 microversion: 2.1 time: 0.030014 Aug 08 14:37:19.032005 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 465/962] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:18 2022] GET /compute/v2.1/servers/1910a72b-e9e2-4e40-8c8d-4f0d4b3ec0d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:37:19.036651 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f01b3a05-e62c-4314-8124-919b1f4cd0b8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '.version_select at 0x7f9cb243f4c0>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:19.055809 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f01b3a05-e62c-4314-8124-919b1f4cd0b8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193920526" status: 202 len: 0 microversion: 2.1 time: 0.022969 Aug 08 14:37:19.056351 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 498/963] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Aug 8 14:37:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193920526 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:37:19.366021 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c4d394c5-6561-4458-9c24-440837272b8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:19.366630 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c4d394c5-6561-4458-9c24-440837272b8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:19.372602 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c4d394c5-6561-4458-9c24-440837272b8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:19.373129 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c4d394c5-6561-4458-9c24-440837272b8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:19.373765 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c4d394c5-6561-4458-9c24-440837272b8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:19.374639 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c4d394c5-6561-4458-9c24-440837272b8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:19.375328 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c4d394c5-6561-4458-9c24-440837272b8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:19.375926 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c4d394c5-6561-4458-9c24-440837272b8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:19.513514 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c4d394c5-6561-4458-9c24-440837272b8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:19.521893 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c4d394c5-6561-4458-9c24-440837272b8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:19.523763 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c4d394c5-6561-4458-9c24-440837272b8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:19.524931 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c4d394c5-6561-4458-9c24-440837272b8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1744 microversion: 2.20 time: 0.163500 Aug 08 14:37:19.525484 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 466/964] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:19 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:19.558328 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-46244a2c-87b2-47f7-a89f-e7d3199c3b19 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:19.559109 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-46244a2c-87b2-47f7-a89f-e7d3199c3b19 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:19.566137 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46244a2c-87b2-47f7-a89f-e7d3199c3b19 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:19.566756 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46244a2c-87b2-47f7-a89f-e7d3199c3b19 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:19.567349 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46244a2c-87b2-47f7-a89f-e7d3199c3b19 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:19.568161 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46244a2c-87b2-47f7-a89f-e7d3199c3b19 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:19.568769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46244a2c-87b2-47f7-a89f-e7d3199c3b19 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:19.569362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-46244a2c-87b2-47f7-a89f-e7d3199c3b19 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:19.720674 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-46244a2c-87b2-47f7-a89f-e7d3199c3b19 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:19.729785 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-46244a2c-87b2-47f7-a89f-e7d3199c3b19 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1682 microversion: 2.1 time: 0.176218 Aug 08 14:37:19.739331 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 499/965] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:19 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:19.777474 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9a8948e6-1599-40f9-a26a-c37d51b7e1d6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:19.778270 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9a8948e6-1599-40f9-a26a-c37d51b7e1d6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:19.785453 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9a8948e6-1599-40f9-a26a-c37d51b7e1d6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:19.786009 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9a8948e6-1599-40f9-a26a-c37d51b7e1d6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:19.786884 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9a8948e6-1599-40f9-a26a-c37d51b7e1d6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:19.788483 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9a8948e6-1599-40f9-a26a-c37d51b7e1d6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:19.789499 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9a8948e6-1599-40f9-a26a-c37d51b7e1d6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:19.789499 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9a8948e6-1599-40f9-a26a-c37d51b7e1d6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:19.946282 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9a8948e6-1599-40f9-a26a-c37d51b7e1d6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:19.954744 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9a8948e6-1599-40f9-a26a-c37d51b7e1d6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.183244 Aug 08 14:37:19.955410 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 467/966] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:19 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:20.361159 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-e519d014-6c05-4ebb-931a-d7fd6979ba80 req-7d8059f9-b2a6-4c64-b60a-e355f070785f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79aaf7b-bbdb-42b5-a337-89102612ff93", "name": "network-vif-plugged", "status": "completed", "tag": "9bfd7cef-c545-4cf2-8212-293910501379"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:20.374398 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-e519d014-6c05-4ebb-931a-d7fd6979ba80 req-7d8059f9-b2a6-4c64-b60a-e355f070785f service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:20.375198 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-e519d014-6c05-4ebb-931a-d7fd6979ba80 req-7d8059f9-b2a6-4c64-b60a-e355f070785f service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:20.376024 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-e519d014-6c05-4ebb-931a-d7fd6979ba80 req-7d8059f9-b2a6-4c64-b60a-e355f070785f service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:20.397759 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-e519d014-6c05-4ebb-931a-d7fd6979ba80 req-7d8059f9-b2a6-4c64-b60a-e355f070785f service nova] Creating event network-vif-plugged:9bfd7cef-c545-4cf2-8212-293910501379 for instance c79aaf7b-bbdb-42b5-a337-89102612ff93 on hv-cinder-85200 Aug 08 14:37:20.404946 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-e519d014-6c05-4ebb-931a-d7fd6979ba80 req-7d8059f9-b2a6-4c64-b60a-e355f070785f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047995 Aug 08 14:37:20.406525 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 500/967] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:20.548286 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-eb192220-127f-4328-b535-e43f2a47cb3a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:20.548899 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-eb192220-127f-4328-b535-e43f2a47cb3a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:20.555544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eb192220-127f-4328-b535-e43f2a47cb3a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:20.556301 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eb192220-127f-4328-b535-e43f2a47cb3a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:20.556746 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eb192220-127f-4328-b535-e43f2a47cb3a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:20.557493 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eb192220-127f-4328-b535-e43f2a47cb3a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:20.557918 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eb192220-127f-4328-b535-e43f2a47cb3a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:20.558344 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eb192220-127f-4328-b535-e43f2a47cb3a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:20.726635 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-eb192220-127f-4328-b535-e43f2a47cb3a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:20.747293 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-eb192220-127f-4328-b535-e43f2a47cb3a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:20.751899 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-eb192220-127f-4328-b535-e43f2a47cb3a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:20.753513 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-eb192220-127f-4328-b535-e43f2a47cb3a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1739 microversion: 2.20 time: 0.209271 Aug 08 14:37:20.753921 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-907a648b-b546-4704-a215-297b9d109d51 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:20.755354 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-907a648b-b546-4704-a215-297b9d109d51 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:20.773749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 468/968] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:20 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:20.777938 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-907a648b-b546-4704-a215-297b9d109d51 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:20.779149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-907a648b-b546-4704-a215-297b9d109d51 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:20.780019 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-907a648b-b546-4704-a215-297b9d109d51 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:20.781244 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-907a648b-b546-4704-a215-297b9d109d51 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:20.781970 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-907a648b-b546-4704-a215-297b9d109d51 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:20.782661 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-907a648b-b546-4704-a215-297b9d109d51 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:20.870090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-907a648b-b546-4704-a215-297b9d109d51 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:20.883822 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-907a648b-b546-4704-a215-297b9d109d51 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 200 len: 1614 microversion: 2.1 time: 0.134400 Aug 08 14:37:20.892224 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 501/969] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:20 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 1614 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:20.899968 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-9c5b0c45-7a23-479c-ba31-4c05e30f803a req-a2e5c1bd-4a7a-4a8e-9d5d-35ebc6f9d8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba51345a-39b0-42ed-b0af-bff1e07fd698", "name": "network-vif-deleted", "tag": "7ec70809-83bf-4ac1-8bc8-709bc220f063"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:20.922396 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-9c5b0c45-7a23-479c-ba31-4c05e30f803a req-a2e5c1bd-4a7a-4a8e-9d5d-35ebc6f9d8c8 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:20.923331 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-9c5b0c45-7a23-479c-ba31-4c05e30f803a req-a2e5c1bd-4a7a-4a8e-9d5d-35ebc6f9d8c8 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:20.924002 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-9c5b0c45-7a23-479c-ba31-4c05e30f803a req-a2e5c1bd-4a7a-4a8e-9d5d-35ebc6f9d8c8 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:20.936659 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-9c5b0c45-7a23-479c-ba31-4c05e30f803a req-a2e5c1bd-4a7a-4a8e-9d5d-35ebc6f9d8c8 service nova] Creating event network-vif-deleted:7ec70809-83bf-4ac1-8bc8-709bc220f063 for instance ba51345a-39b0-42ed-b0af-bff1e07fd698 on hv-cinder-85200 Aug 08 14:37:20.942354 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-9c5b0c45-7a23-479c-ba31-4c05e30f803a req-a2e5c1bd-4a7a-4a8e-9d5d-35ebc6f9d8c8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046595 Aug 08 14:37:20.943161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 469/970] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:20.977158 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1ecff529-e5fe-40d9-bee1-d291b80b4cbc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:20.978415 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1ecff529-e5fe-40d9-bee1-d291b80b4cbc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:20.986400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1ecff529-e5fe-40d9-bee1-d291b80b4cbc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:20.990244 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1ecff529-e5fe-40d9-bee1-d291b80b4cbc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:20.992093 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1ecff529-e5fe-40d9-bee1-d291b80b4cbc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:20.993035 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1ecff529-e5fe-40d9-bee1-d291b80b4cbc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:20.993657 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1ecff529-e5fe-40d9-bee1-d291b80b4cbc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:20.994756 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1ecff529-e5fe-40d9-bee1-d291b80b4cbc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:21.167817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-1ecff529-e5fe-40d9-bee1-d291b80b4cbc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:21.177634 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1ecff529-e5fe-40d9-bee1-d291b80b4cbc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.204571 Aug 08 14:37:21.194301 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 502/971] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:20 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:21.783368 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b115562d-97f8-426a-886c-80ecb4bf5ad5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:21.784063 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b115562d-97f8-426a-886c-80ecb4bf5ad5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:21.791883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b115562d-97f8-426a-886c-80ecb4bf5ad5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:21.796500 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b115562d-97f8-426a-886c-80ecb4bf5ad5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:21.797730 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b115562d-97f8-426a-886c-80ecb4bf5ad5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:21.798706 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b115562d-97f8-426a-886c-80ecb4bf5ad5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:21.799432 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b115562d-97f8-426a-886c-80ecb4bf5ad5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:21.801744 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b115562d-97f8-426a-886c-80ecb4bf5ad5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:21.908142 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5e096994-3d16-4c6a-97cf-b4df6be6dba5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:21.908882 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5e096994-3d16-4c6a-97cf-b4df6be6dba5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:21.917452 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e096994-3d16-4c6a-97cf-b4df6be6dba5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:21.918238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e096994-3d16-4c6a-97cf-b4df6be6dba5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:21.918869 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e096994-3d16-4c6a-97cf-b4df6be6dba5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:21.919795 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e096994-3d16-4c6a-97cf-b4df6be6dba5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:21.920437 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e096994-3d16-4c6a-97cf-b4df6be6dba5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:21.921067 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e096994-3d16-4c6a-97cf-b4df6be6dba5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:21.947698 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-5e096994-3d16-4c6a-97cf-b4df6be6dba5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] HTTP exception thrown: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5e096994-3d16-4c6a-97cf-b4df6be6dba5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Request method failure captured: Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 HTTP/1.1 Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4nDHzBnzio2VZ6ciHSRMNEEHFIYRjyMTvKRDfIH2F_niI0FcU0ZqBeBBZkKpUdHOb90TorX284g0qMdisJyL77Y3j06R-x49-mqWZufa0BFWwlg29tIQoalg1p609ZLEly-KDP4mLoxCO4eWlqZVpPuU5-IPf0H50niq4AklVZ208 Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:37:21.949755 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:37:21.951455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc86120e53145328dd430f542e73182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc86120e53145328dd430f542e73182", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}] Aug 08 14:37:21.951455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:37:21.951455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:37:21.951455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:37:21.951455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:37:21.951455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:37:21.951455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:37:21.951455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 48a91f6797cc4604ba2606e0549234d0 Aug 08 14:37:21.951455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:37:21.951455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:37:21.951455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:37:21.951455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': 'ba51345a-39b0-42ed-b0af-bff1e07fd698'} Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:37:21.952395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:37:21.953964 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:21.955350 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5e096994-3d16-4c6a-97cf-b4df6be6dba5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Returning 404 to user: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:37:21.957831 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5e096994-3d16-4c6a-97cf-b4df6be6dba5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 404 len: 111 microversion: 2.1 time: 0.051373 Aug 08 14:37:21.958626 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 503/972] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:21 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 14:37:21.967587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-70ffe26a-5d3d-48c1-8c81-23cfa3fb9830 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '.version_select at 0x7f9cb24ff700>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:21.980505 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b115562d-97f8-426a-886c-80ecb4bf5ad5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:21.989809 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-70ffe26a-5d3d-48c1-8c81-23cfa3fb9830 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-423480582" status: 202 len: 0 microversion: 2.1 time: 0.026526 Aug 08 14:37:21.990270 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b115562d-97f8-426a-886c-80ecb4bf5ad5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:21.991961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 504/973] 10.222.0.50 () {58 vars in 1218 bytes} [Mon Aug 8 14:37:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-423480582 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:37:21.993504 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b115562d-97f8-426a-886c-80ecb4bf5ad5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:21.997967 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b115562d-97f8-426a-886c-80ecb4bf5ad5 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1739 microversion: 2.20 time: 0.216799 Aug 08 14:37:21.999301 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 470/974] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:21 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:22.206134 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0c07cad5-b3b8-45de-adfd-47673db7f2ac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:22.207171 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-0c07cad5-b3b8-45de-adfd-47673db7f2ac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:22.216264 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c07cad5-b3b8-45de-adfd-47673db7f2ac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:22.217150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c07cad5-b3b8-45de-adfd-47673db7f2ac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:22.218025 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c07cad5-b3b8-45de-adfd-47673db7f2ac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:22.219738 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c07cad5-b3b8-45de-adfd-47673db7f2ac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:22.220687 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c07cad5-b3b8-45de-adfd-47673db7f2ac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:22.221622 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0c07cad5-b3b8-45de-adfd-47673db7f2ac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:22.430764 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-0c07cad5-b3b8-45de-adfd-47673db7f2ac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:22.444048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0c07cad5-b3b8-45de-adfd-47673db7f2ac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.241817 Aug 08 14:37:22.450590 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 505/975] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:22 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:22.590112 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-72df5446-1da4-4dd0-927a-7499dd3728d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:22.591417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-72df5446-1da4-4dd0-927a-7499dd3728d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:22.597946 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72df5446-1da4-4dd0-927a-7499dd3728d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:22.598709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72df5446-1da4-4dd0-927a-7499dd3728d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:22.599428 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72df5446-1da4-4dd0-927a-7499dd3728d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:22.600419 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72df5446-1da4-4dd0-927a-7499dd3728d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:22.601514 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72df5446-1da4-4dd0-927a-7499dd3728d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:22.602171 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72df5446-1da4-4dd0-927a-7499dd3728d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:22.636448 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-72df5446-1da4-4dd0-927a-7499dd3728d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:37:22.775323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-72df5446-1da4-4dd0-927a-7499dd3728d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 204 len: 0 microversion: 2.1 time: 0.192338 Aug 08 14:37:22.776198 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 471/976] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:37:22 2022] DELETE /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:37:22.786014 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-21a8a2a9-e883-4e2e-8b58-7fc75da7708d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:22.786717 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-21a8a2a9-e883-4e2e-8b58-7fc75da7708d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:22.809187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-21a8a2a9-e883-4e2e-8b58-7fc75da7708d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:22.809806 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-21a8a2a9-e883-4e2e-8b58-7fc75da7708d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:22.810318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-21a8a2a9-e883-4e2e-8b58-7fc75da7708d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:22.811307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-21a8a2a9-e883-4e2e-8b58-7fc75da7708d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:22.812307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-21a8a2a9-e883-4e2e-8b58-7fc75da7708d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:22.812829 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-21a8a2a9-e883-4e2e-8b58-7fc75da7708d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:22.912259 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5ad835f3-0d4a-404c-bf8b-c4f345df8c5e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Action: 'create', calling method: .version_select at 0x7f9cb240ea60>, body: {"keypair": {"name": "tempest-keypair-1227137178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAd2E1kfph6UiQJR4RfJiyOs6QeObZVBsqqxN0fae/tyJCLsZvsHFr4EbYEhHx90O5llRIfe7XKtNkKKGaXG/ZDB9ESLzxYMD0QaTyhs1zWwcG82+uE7U3AFydJC97x5g=="}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:22.946221 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-5ad835f3-0d4a-404c-bf8b-c4f345df8c5e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for project cfc86120e53145328dd430f542e73182. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:37:22.951407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-5ad835f3-0d4a-404c-bf8b-c4f345df8c5e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for user 48a91f6797cc4604ba2606e0549234d0 and project cfc86120e53145328dd430f542e73182. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:37:22.981430 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5ad835f3-0d4a-404c-bf8b-c4f345df8c5e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074766 Aug 08 14:37:22.982701 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 472/977] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 14:37:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:23.006025 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-21a8a2a9-e883-4e2e-8b58-7fc75da7708d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:23.021995 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b3ddddbb-b69c-4b04-b6a9-80de52f97776 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:23.023808 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-21a8a2a9-e883-4e2e-8b58-7fc75da7708d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1509 microversion: 2.1 time: 0.234283 Aug 08 14:37:23.035114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 506/978] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:22 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:23.039382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b3ddddbb-b69c-4b04-b6a9-80de52f97776 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:23.044517 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b3ddddbb-b69c-4b04-b6a9-80de52f97776 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:23.045059 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b3ddddbb-b69c-4b04-b6a9-80de52f97776 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:23.045865 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b3ddddbb-b69c-4b04-b6a9-80de52f97776 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:23.046589 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b3ddddbb-b69c-4b04-b6a9-80de52f97776 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:23.047121 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b3ddddbb-b69c-4b04-b6a9-80de52f97776 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:23.047557 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b3ddddbb-b69c-4b04-b6a9-80de52f97776 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:23.226204 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b3ddddbb-b69c-4b04-b6a9-80de52f97776 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:23.234092 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b3ddddbb-b69c-4b04-b6a9-80de52f97776 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:23.235691 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b3ddddbb-b69c-4b04-b6a9-80de52f97776 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:23.237361 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b3ddddbb-b69c-4b04-b6a9-80de52f97776 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1739 microversion: 2.20 time: 0.219900 Aug 08 14:37:23.238295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 473/979] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:23 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:23.471598 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ce6a9a90-b619-4f49-a484-d30ef60fab18 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:23.472909 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ce6a9a90-b619-4f49-a484-d30ef60fab18 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:23.484394 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce6a9a90-b619-4f49-a484-d30ef60fab18 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:23.485207 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce6a9a90-b619-4f49-a484-d30ef60fab18 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:23.486123 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce6a9a90-b619-4f49-a484-d30ef60fab18 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:23.487068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce6a9a90-b619-4f49-a484-d30ef60fab18 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:23.489799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce6a9a90-b619-4f49-a484-d30ef60fab18 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:23.491006 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce6a9a90-b619-4f49-a484-d30ef60fab18 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:23.679637 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ce6a9a90-b619-4f49-a484-d30ef60fab18 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:23.690609 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ce6a9a90-b619-4f49-a484-d30ef60fab18 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.223307 Aug 08 14:37:23.703114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 507/980] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:23 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:24.045782 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-44b583d5-7990-4f95-8d03-889e1c9faae8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:24.047082 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-44b583d5-7990-4f95-8d03-889e1c9faae8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:24.056476 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-44b583d5-7990-4f95-8d03-889e1c9faae8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:24.057362 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-44b583d5-7990-4f95-8d03-889e1c9faae8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:24.057932 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-44b583d5-7990-4f95-8d03-889e1c9faae8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:24.058914 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-44b583d5-7990-4f95-8d03-889e1c9faae8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:24.059762 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-44b583d5-7990-4f95-8d03-889e1c9faae8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:24.061574 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-44b583d5-7990-4f95-8d03-889e1c9faae8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:24.244491 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-44b583d5-7990-4f95-8d03-889e1c9faae8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:24.257219 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-44b583d5-7990-4f95-8d03-889e1c9faae8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1509 microversion: 2.1 time: 0.215208 Aug 08 14:37:24.260613 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 474/981] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:24 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:24.262617 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7b0c806f-b587-4419-b11a-de5aedaaf5f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:24.263933 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7b0c806f-b587-4419-b11a-de5aedaaf5f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:24.270454 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7b0c806f-b587-4419-b11a-de5aedaaf5f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:24.271068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7b0c806f-b587-4419-b11a-de5aedaaf5f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:24.271893 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7b0c806f-b587-4419-b11a-de5aedaaf5f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:24.272794 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7b0c806f-b587-4419-b11a-de5aedaaf5f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:24.273407 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7b0c806f-b587-4419-b11a-de5aedaaf5f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:24.273995 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7b0c806f-b587-4419-b11a-de5aedaaf5f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:24.438265 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7b0c806f-b587-4419-b11a-de5aedaaf5f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:24.447655 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7b0c806f-b587-4419-b11a-de5aedaaf5f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:24.453068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7b0c806f-b587-4419-b11a-de5aedaaf5f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:24.457453 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7b0c806f-b587-4419-b11a-de5aedaaf5f7 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1739 microversion: 2.20 time: 0.200543 Aug 08 14:37:24.458222 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 508/982] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:24 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:24.629173 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-516326027", "imageRef": "667e3b45-0f46-49af-aaff-80b88a321e87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fc22420-3005-4d46-a261-c4b4ae68cba2"}], "security_groups": [{"name": "tempest-securitygroup--1551408193"}], "key_name": "tempest-keypair-1227137178", "user_data": "}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:24.712058 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c9b335be-a10d-48ac-a788-de0d9430918a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:24.712764 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c9b335be-a10d-48ac-a788-de0d9430918a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:24.718952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9b335be-a10d-48ac-a788-de0d9430918a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:24.719792 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9b335be-a10d-48ac-a788-de0d9430918a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:24.720465 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9b335be-a10d-48ac-a788-de0d9430918a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:24.721393 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9b335be-a10d-48ac-a788-de0d9430918a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:24.722341 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9b335be-a10d-48ac-a788-de0d9430918a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:24.723009 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9b335be-a10d-48ac-a788-de0d9430918a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:24.804851 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] validate_networks() for [('3fc22420-3005-4d46-a261-c4b4ae68cba2', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:37:24.991939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c9b335be-a10d-48ac-a788-de0d9430918a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:25.002433 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c9b335be-a10d-48ac-a788-de0d9430918a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.294162 Aug 08 14:37:25.004241 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 509/983] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:24 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:25.280433 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-83aadb00-b446-4dd3-924a-a87eaafa73d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:25.281097 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-83aadb00-b446-4dd3-924a-a87eaafa73d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:25.289286 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83aadb00-b446-4dd3-924a-a87eaafa73d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:25.289779 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83aadb00-b446-4dd3-924a-a87eaafa73d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:25.290218 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83aadb00-b446-4dd3-924a-a87eaafa73d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:25.290924 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83aadb00-b446-4dd3-924a-a87eaafa73d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:25.291438 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83aadb00-b446-4dd3-924a-a87eaafa73d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:25.291867 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83aadb00-b446-4dd3-924a-a87eaafa73d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:25.451213 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:37:25.451213 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:37:25.451213 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:37:25.451213 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:37:25.452598 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:37:25.469250 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:25.470168 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:25.470702 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:25.471710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:25.472218 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:25.473000 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:25.509169 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-83aadb00-b446-4dd3-924a-a87eaafa73d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:25.519355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-83aadb00-b446-4dd3-924a-a87eaafa73d8 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1509 microversion: 2.1 time: 0.240851 Aug 08 14:37:25.533099 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 510/984] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:25 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:25.540563 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-677b35f2-f857-41e6-98d3-9de9c5ea8796 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:25.541906 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for project cfc86120e53145328dd430f542e73182. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:37:25.547002 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Getting quotas for user 48a91f6797cc4604ba2606e0549234d0 and project cfc86120e53145328dd430f542e73182. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:37:25.547233 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-677b35f2-f857-41e6-98d3-9de9c5ea8796 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:25.558871 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-677b35f2-f857-41e6-98d3-9de9c5ea8796 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:25.559728 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-677b35f2-f857-41e6-98d3-9de9c5ea8796 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:25.561987 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-677b35f2-f857-41e6-98d3-9de9c5ea8796 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:25.562716 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-677b35f2-f857-41e6-98d3-9de9c5ea8796 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:25.563200 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-677b35f2-f857-41e6-98d3-9de9c5ea8796 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:25.565716 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-677b35f2-f857-41e6-98d3-9de9c5ea8796 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:25.570435 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:25.578424 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:37:25.581298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='667e3b45-0f46-49af-aaff-80b88a321e87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:37:25.671876 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c9142164-1c59-410e-8300-6b8096503e0f tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.047258 Aug 08 14:37:25.673854 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 475/985] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:37:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:37:25.685568 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9692cdb8-7d9a-41b4-95e7-6e8df317e97b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:25.686503 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9692cdb8-7d9a-41b4-95e7-6e8df317e97b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:25.780914 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9692cdb8-7d9a-41b4-95e7-6e8df317e97b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:25.793614 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9692cdb8-7d9a-41b4-95e7-6e8df317e97b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1241 microversion: 2.1 time: 0.111784 Aug 08 14:37:25.794743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 476/986] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:25 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:25.820948 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-677b35f2-f857-41e6-98d3-9de9c5ea8796 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:25.831668 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-677b35f2-f857-41e6-98d3-9de9c5ea8796 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:25.835556 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-677b35f2-f857-41e6-98d3-9de9c5ea8796 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:25.837065 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-677b35f2-f857-41e6-98d3-9de9c5ea8796 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1739 microversion: 2.20 time: 0.302625 Aug 08 14:37:25.851986 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 511/987] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:25 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1739 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:26.029943 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-eba0cd17-bcbd-4ff7-8be7-d8ecc7685801 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:26.031074 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-eba0cd17-bcbd-4ff7-8be7-d8ecc7685801 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:26.038783 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba0cd17-bcbd-4ff7-8be7-d8ecc7685801 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:26.039576 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba0cd17-bcbd-4ff7-8be7-d8ecc7685801 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:26.040353 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba0cd17-bcbd-4ff7-8be7-d8ecc7685801 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:26.041370 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba0cd17-bcbd-4ff7-8be7-d8ecc7685801 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:26.042032 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba0cd17-bcbd-4ff7-8be7-d8ecc7685801 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:26.042702 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba0cd17-bcbd-4ff7-8be7-d8ecc7685801 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:26.265852 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-eba0cd17-bcbd-4ff7-8be7-d8ecc7685801 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:26.278263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-eba0cd17-bcbd-4ff7-8be7-d8ecc7685801 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.257747 Aug 08 14:37:26.279641 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 477/988] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:26 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:26.362065 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-3b268844-2dfb-4d71-8740-627480e49e49 req-bd78dcc0-c7b5-4886-9da7-fe6f0f2bff94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34e27d5-eb90-4a3c-8d9c-64a0404431d4", "name": "network-vif-deleted", "tag": "c9810bc7-4497-4380-9d9b-44cf29ea15c5"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:26.379280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-3b268844-2dfb-4d71-8740-627480e49e49 req-bd78dcc0-c7b5-4886-9da7-fe6f0f2bff94 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:26.380196 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-3b268844-2dfb-4d71-8740-627480e49e49 req-bd78dcc0-c7b5-4886-9da7-fe6f0f2bff94 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:26.382325 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-3b268844-2dfb-4d71-8740-627480e49e49 req-bd78dcc0-c7b5-4886-9da7-fe6f0f2bff94 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:26.401686 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-3b268844-2dfb-4d71-8740-627480e49e49 req-bd78dcc0-c7b5-4886-9da7-fe6f0f2bff94 service nova] Creating event network-vif-deleted:c9810bc7-4497-4380-9d9b-44cf29ea15c5 for instance e34e27d5-eb90-4a3c-8d9c-64a0404431d4 on hv-cinder-85200 Aug 08 14:37:26.408858 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-3b268844-2dfb-4d71-8740-627480e49e49 req-bd78dcc0-c7b5-4886-9da7-fe6f0f2bff94 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053013 Aug 08 14:37:26.410256 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 512/989] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:37:26.540775 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f0d6a669-5c0a-4bbb-ba10-73770c98becc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:26.541495 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f0d6a669-5c0a-4bbb-ba10-73770c98becc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:26.547327 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f0d6a669-5c0a-4bbb-ba10-73770c98becc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:26.547808 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f0d6a669-5c0a-4bbb-ba10-73770c98becc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:26.548241 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f0d6a669-5c0a-4bbb-ba10-73770c98becc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:26.548928 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f0d6a669-5c0a-4bbb-ba10-73770c98becc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:26.549383 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f0d6a669-5c0a-4bbb-ba10-73770c98becc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:26.549799 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f0d6a669-5c0a-4bbb-ba10-73770c98becc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:26.576467 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:26.696777 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f0d6a669-5c0a-4bbb-ba10-73770c98becc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:26.707357 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f0d6a669-5c0a-4bbb-ba10-73770c98becc tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1293 microversion: 2.1 time: 0.170335 Aug 08 14:37:26.708471 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 478/990] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:26 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1293 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:26.814328 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b1474827-1ae3-482e-b60d-229572c268cf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:26.815383 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b1474827-1ae3-482e-b60d-229572c268cf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:26.826600 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b1474827-1ae3-482e-b60d-229572c268cf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:26.827126 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b1474827-1ae3-482e-b60d-229572c268cf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:26.827583 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b1474827-1ae3-482e-b60d-229572c268cf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:26.828288 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b1474827-1ae3-482e-b60d-229572c268cf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:26.828775 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b1474827-1ae3-482e-b60d-229572c268cf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:26.829202 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b1474827-1ae3-482e-b60d-229572c268cf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:26.861730 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-747180dc-07e3-4fdd-8f9e-897f9b4a331d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:26.862624 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-747180dc-07e3-4fdd-8f9e-897f9b4a331d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:26.871215 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-747180dc-07e3-4fdd-8f9e-897f9b4a331d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:26.875798 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-747180dc-07e3-4fdd-8f9e-897f9b4a331d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:26.880580 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-747180dc-07e3-4fdd-8f9e-897f9b4a331d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:26.882081 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-747180dc-07e3-4fdd-8f9e-897f9b4a331d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:26.882555 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-747180dc-07e3-4fdd-8f9e-897f9b4a331d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:26.882984 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-747180dc-07e3-4fdd-8f9e-897f9b4a331d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:26.937180 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b1474827-1ae3-482e-b60d-229572c268cf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:26.946102 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b1474827-1ae3-482e-b60d-229572c268cf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1293 microversion: 2.1 time: 0.135955 Aug 08 14:37:26.946988 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 513/991] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:26 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1293 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:27.028709 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-747180dc-07e3-4fdd-8f9e-897f9b4a331d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:27.037971 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-747180dc-07e3-4fdd-8f9e-897f9b4a331d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:27.039586 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-747180dc-07e3-4fdd-8f9e-897f9b4a331d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:27.040799 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-747180dc-07e3-4fdd-8f9e-897f9b4a331d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1739 microversion: 2.20 time: 0.182868 Aug 08 14:37:27.041292 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 479/992] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:26 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:27.300871 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-83f4ef2b-ab0f-48ee-a3d9-1b22085d1ab4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:27.301481 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-83f4ef2b-ab0f-48ee-a3d9-1b22085d1ab4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:27.307637 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83f4ef2b-ab0f-48ee-a3d9-1b22085d1ab4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:27.308133 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83f4ef2b-ab0f-48ee-a3d9-1b22085d1ab4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:27.308575 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83f4ef2b-ab0f-48ee-a3d9-1b22085d1ab4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:27.309275 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83f4ef2b-ab0f-48ee-a3d9-1b22085d1ab4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:27.309886 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83f4ef2b-ab0f-48ee-a3d9-1b22085d1ab4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:27.310322 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83f4ef2b-ab0f-48ee-a3d9-1b22085d1ab4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:27.499058 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-83f4ef2b-ab0f-48ee-a3d9-1b22085d1ab4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:27.507269 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-83f4ef2b-ab0f-48ee-a3d9-1b22085d1ab4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.210721 Aug 08 14:37:27.511513 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 514/993] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:27 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:27.728346 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-55931f58-76a0-4f83-b295-994c5f3950fd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:27.729607 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-55931f58-76a0-4f83-b295-994c5f3950fd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:27.736577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-55931f58-76a0-4f83-b295-994c5f3950fd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:27.737069 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-55931f58-76a0-4f83-b295-994c5f3950fd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:27.737513 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-55931f58-76a0-4f83-b295-994c5f3950fd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:27.738224 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-55931f58-76a0-4f83-b295-994c5f3950fd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:27.738686 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-55931f58-76a0-4f83-b295-994c5f3950fd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:27.739133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-55931f58-76a0-4f83-b295-994c5f3950fd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:27.771427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-55931f58-76a0-4f83-b295-994c5f3950fd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:27.772228 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-55931f58-76a0-4f83-b295-994c5f3950fd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:27.773331 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-55931f58-76a0-4f83-b295-994c5f3950fd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:27.773967 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-55931f58-76a0-4f83-b295-994c5f3950fd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lazy-loading 'fault' on Instance uuid e34e27d5-eb90-4a3c-8d9c-64a0404431d4 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:37:27.816153 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-55931f58-76a0-4f83-b295-994c5f3950fd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:27.824468 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-55931f58-76a0-4f83-b295-994c5f3950fd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1312 microversion: 2.1 time: 0.100042 Aug 08 14:37:27.839175 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 480/994] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:27 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:27.967289 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9acc9e41-0b1c-4cec-a994-7f80b3e06e7e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:27.968216 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9acc9e41-0b1c-4cec-a994-7f80b3e06e7e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:27.974850 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9acc9e41-0b1c-4cec-a994-7f80b3e06e7e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:27.975460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9acc9e41-0b1c-4cec-a994-7f80b3e06e7e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:27.975978 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9acc9e41-0b1c-4cec-a994-7f80b3e06e7e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:27.976855 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9acc9e41-0b1c-4cec-a994-7f80b3e06e7e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:27.977392 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9acc9e41-0b1c-4cec-a994-7f80b3e06e7e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:27.977922 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9acc9e41-0b1c-4cec-a994-7f80b3e06e7e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:28.050054 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9acc9e41-0b1c-4cec-a994-7f80b3e06e7e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:28.061394 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9acc9e41-0b1c-4cec-a994-7f80b3e06e7e tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1301 microversion: 2.1 time: 0.098108 Aug 08 14:37:28.064897 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d03168a0-a0be-4e2f-be3d-41fabd317033 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:28.065775 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d03168a0-a0be-4e2f-be3d-41fabd317033 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:28.073055 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d03168a0-a0be-4e2f-be3d-41fabd317033 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:28.073791 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d03168a0-a0be-4e2f-be3d-41fabd317033 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:28.074441 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d03168a0-a0be-4e2f-be3d-41fabd317033 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:28.075434 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d03168a0-a0be-4e2f-be3d-41fabd317033 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:28.076108 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d03168a0-a0be-4e2f-be3d-41fabd317033 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:28.076895 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d03168a0-a0be-4e2f-be3d-41fabd317033 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:28.078803 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 515/995] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:27 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1301 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:28.220795 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d03168a0-a0be-4e2f-be3d-41fabd317033 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:28.229462 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d03168a0-a0be-4e2f-be3d-41fabd317033 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:28.231776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d03168a0-a0be-4e2f-be3d-41fabd317033 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:28.232955 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d03168a0-a0be-4e2f-be3d-41fabd317033 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1739 microversion: 2.20 time: 0.172365 Aug 08 14:37:28.239200 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 481/996] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:28 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:28.530924 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ea790fc0-fd8e-4908-b642-7d6f3cb9abac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:28.531746 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ea790fc0-fd8e-4908-b642-7d6f3cb9abac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:28.541522 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ea790fc0-fd8e-4908-b642-7d6f3cb9abac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:28.542259 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ea790fc0-fd8e-4908-b642-7d6f3cb9abac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:28.542882 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ea790fc0-fd8e-4908-b642-7d6f3cb9abac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:28.543611 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ea790fc0-fd8e-4908-b642-7d6f3cb9abac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:28.544280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ea790fc0-fd8e-4908-b642-7d6f3cb9abac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:28.544707 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ea790fc0-fd8e-4908-b642-7d6f3cb9abac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:28.697692 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ea790fc0-fd8e-4908-b642-7d6f3cb9abac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:28.706546 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ea790fc0-fd8e-4908-b642-7d6f3cb9abac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.181548 Aug 08 14:37:28.707348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 516/997] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:28 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:28.920863 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-25370587-4072-4f83-8eee-5c976af72a4a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:28.921620 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-25370587-4072-4f83-8eee-5c976af72a4a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:28.933163 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25370587-4072-4f83-8eee-5c976af72a4a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:28.933783 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25370587-4072-4f83-8eee-5c976af72a4a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:28.934316 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25370587-4072-4f83-8eee-5c976af72a4a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:28.938276 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25370587-4072-4f83-8eee-5c976af72a4a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:28.939125 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25370587-4072-4f83-8eee-5c976af72a4a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:28.939304 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25370587-4072-4f83-8eee-5c976af72a4a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:28.982683 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25370587-4072-4f83-8eee-5c976af72a4a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:28.983323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25370587-4072-4f83-8eee-5c976af72a4a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:28.984033 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25370587-4072-4f83-8eee-5c976af72a4a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:28.984571 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-25370587-4072-4f83-8eee-5c976af72a4a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lazy-loading 'fault' on Instance uuid e34e27d5-eb90-4a3c-8d9c-64a0404431d4 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:37:29.032174 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-25370587-4072-4f83-8eee-5c976af72a4a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:29.041016 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-25370587-4072-4f83-8eee-5c976af72a4a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 200 len: 1312 microversion: 2.1 time: 0.198843 Aug 08 14:37:29.054131 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 482/998] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:28 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 1312 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:29.082692 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f2091574-21bb-4e34-aafa-8609d0434a4a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:29.083448 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f2091574-21bb-4e34-aafa-8609d0434a4a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:29.090914 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2091574-21bb-4e34-aafa-8609d0434a4a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:29.091557 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2091574-21bb-4e34-aafa-8609d0434a4a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:29.092072 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2091574-21bb-4e34-aafa-8609d0434a4a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:29.092858 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2091574-21bb-4e34-aafa-8609d0434a4a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:29.093395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2091574-21bb-4e34-aafa-8609d0434a4a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:29.093905 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f2091574-21bb-4e34-aafa-8609d0434a4a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:29.213919 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f2091574-21bb-4e34-aafa-8609d0434a4a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:29.226577 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f2091574-21bb-4e34-aafa-8609d0434a4a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1311 microversion: 2.1 time: 0.147747 Aug 08 14:37:29.231164 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 517/999] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:29 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1311 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:29.258122 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b141b803-1a08-47c8-ba02-18fe3fa13f18 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:29.258965 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b141b803-1a08-47c8-ba02-18fe3fa13f18 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:29.267502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b141b803-1a08-47c8-ba02-18fe3fa13f18 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:29.270302 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b141b803-1a08-47c8-ba02-18fe3fa13f18 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:29.270918 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b141b803-1a08-47c8-ba02-18fe3fa13f18 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:29.277401 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b141b803-1a08-47c8-ba02-18fe3fa13f18 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:29.278818 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b141b803-1a08-47c8-ba02-18fe3fa13f18 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:29.279309 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b141b803-1a08-47c8-ba02-18fe3fa13f18 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:29.500998 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b141b803-1a08-47c8-ba02-18fe3fa13f18 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:29.510239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b141b803-1a08-47c8-ba02-18fe3fa13f18 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:29.511842 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b141b803-1a08-47c8-ba02-18fe3fa13f18 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:29.513128 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b141b803-1a08-47c8-ba02-18fe3fa13f18 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1739 microversion: 2.20 time: 0.260367 Aug 08 14:37:29.531174 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 483/1000] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:29 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1739 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:29.729621 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b8fe6e50-d956-4357-a838-83f29142478d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:29.730421 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b8fe6e50-d956-4357-a838-83f29142478d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:29.740151 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b8fe6e50-d956-4357-a838-83f29142478d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:29.742217 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b8fe6e50-d956-4357-a838-83f29142478d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:29.743011 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b8fe6e50-d956-4357-a838-83f29142478d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:29.744010 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b8fe6e50-d956-4357-a838-83f29142478d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:29.744751 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b8fe6e50-d956-4357-a838-83f29142478d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:29.745426 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b8fe6e50-d956-4357-a838-83f29142478d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:29.937256 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b8fe6e50-d956-4357-a838-83f29142478d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:29.946376 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b8fe6e50-d956-4357-a838-83f29142478d tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.221817 Aug 08 14:37:29.961256 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 518/1001] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:29 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:30.061310 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3cacdb9f-1193-4746-99f1-37f194107848 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:30.062611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3cacdb9f-1193-4746-99f1-37f194107848 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e34e27d5-eb90-4a3c-8d9c-64a0404431d4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:30.070496 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3cacdb9f-1193-4746-99f1-37f194107848 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:30.071382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3cacdb9f-1193-4746-99f1-37f194107848 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:30.072083 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3cacdb9f-1193-4746-99f1-37f194107848 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:30.072986 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3cacdb9f-1193-4746-99f1-37f194107848 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:30.073667 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3cacdb9f-1193-4746-99f1-37f194107848 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:30.074286 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3cacdb9f-1193-4746-99f1-37f194107848 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:30.093388 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-3cacdb9f-1193-4746-99f1-37f194107848 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] HTTP exception thrown: Instance e34e27d5-eb90-4a3c-8d9c-64a0404431d4 could not be found. Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3cacdb9f-1193-4746-99f1-37f194107848 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Request method failure captured: Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 HTTP/1.1 Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R57J81LntT0wnBLoq0gsHuTcdb_gHa2boWqNwcHJNT7GzMY0xQaN4u9gbPeQMkc14SBA7jeP_d07iW79RHlaNziPk2GWGa1BYt-GMeY3VrGnZvm8TtxiX0dmqfpjGqGooMq0e11KFxasfjzOL609Nmftln0YBM8XLy3f2h8GasueEo Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 6ecb83fbcae94dca82331ab87f028878 Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:37:30.095565 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:37:30.096934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6ecb83fbcae94dca82331ab87f028878"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6ecb83fbcae94dca82331ab87f028878", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ecb83fbcae94dca82331ab87f028878"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ecb83fbcae94dca82331ab87f028878"}]}] Aug 08 14:37:30.096934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:37:30.096934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 6ecb83fbcae94dca82331ab87f028878 Aug 08 14:37:30.096934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:37:30.096934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-ServerRescueNegativeTestJSON-1730375856-project Aug 08 14:37:30.096934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:37:30.096934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:37:30.096934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 7d373dfa8c474ade92e94dc73dd9926f Aug 08 14:37:30.096934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1730375856-project Aug 08 14:37:30.096934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:37:30.096934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance e34e27d5-eb90-4a3c-8d9c-64a0404431d4 could not be found. Aug 08 14:37:30.096934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'e34e27d5-eb90-4a3c-8d9c-64a0404431d4'} Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34e27d5-eb90-4a3c-8d9c-64a0404431d4 could not be found. Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:37:30.097710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34e27d5-eb90-4a3c-8d9c-64a0404431d4 could not be found. Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34e27d5-eb90-4a3c-8d9c-64a0404431d4 could not be found. Aug 08 14:37:30.098973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:30.101518 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3cacdb9f-1193-4746-99f1-37f194107848 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Returning 404 to user: Instance e34e27d5-eb90-4a3c-8d9c-64a0404431d4 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:37:30.102629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3cacdb9f-1193-4746-99f1-37f194107848 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4" status: 404 len: 111 microversion: 2.1 time: 0.045535 Aug 08 14:37:30.103652 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 484/1002] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:30 2022] GET /compute/v2.1/servers/e34e27d5-eb90-4a3c-8d9c-64a0404431d4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 14:37:30.112577 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-45ced48b-1f86-4845-b7d2-acdc8d7d3343 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:30.113931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-45ced48b-1f86-4845-b7d2-acdc8d7d3343 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:30.120924 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45ced48b-1f86-4845-b7d2-acdc8d7d3343 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:30.121597 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45ced48b-1f86-4845-b7d2-acdc8d7d3343 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:30.122194 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45ced48b-1f86-4845-b7d2-acdc8d7d3343 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:30.123048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45ced48b-1f86-4845-b7d2-acdc8d7d3343 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:30.123704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45ced48b-1f86-4845-b7d2-acdc8d7d3343 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:30.124131 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-45ced48b-1f86-4845-b7d2-acdc8d7d3343 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:30.153623 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-45ced48b-1f86-4845-b7d2-acdc8d7d3343 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Going to try to terminate instance {{(pid=118062) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:37:30.251919 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fc051b24-49a2-4b82-bf71-53c17d736933 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:30.252814 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fc051b24-49a2-4b82-bf71-53c17d736933 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:30.266445 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc051b24-49a2-4b82-bf71-53c17d736933 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:30.267769 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc051b24-49a2-4b82-bf71-53c17d736933 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:30.269663 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc051b24-49a2-4b82-bf71-53c17d736933 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:30.271672 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc051b24-49a2-4b82-bf71-53c17d736933 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:30.281790 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc051b24-49a2-4b82-bf71-53c17d736933 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:30.282888 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc051b24-49a2-4b82-bf71-53c17d736933 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:30.303537 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-45ced48b-1f86-4845-b7d2-acdc8d7d3343 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 204 len: 0 microversion: 2.1 time: 0.192692 Aug 08 14:37:30.306061 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 519/1003] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:37:30 2022] DELETE /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:37:30.312712 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d48685c2-8312-44ea-991c-708fd6d5e38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:30.313476 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d48685c2-8312-44ea-991c-708fd6d5e38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:30.321963 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:30.323795 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d48685c2-8312-44ea-991c-708fd6d5e38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:30.326287 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d48685c2-8312-44ea-991c-708fd6d5e38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:30.326753 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d48685c2-8312-44ea-991c-708fd6d5e38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:30.327765 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d48685c2-8312-44ea-991c-708fd6d5e38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:30.330422 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d48685c2-8312-44ea-991c-708fd6d5e38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:30.330879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d48685c2-8312-44ea-991c-708fd6d5e38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:30.577270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d48685c2-8312-44ea-991c-708fd6d5e38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:30.578207 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fc051b24-49a2-4b82-bf71-53c17d736933 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:30.588125 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d48685c2-8312-44ea-991c-708fd6d5e38a tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.280645 Aug 08 14:37:30.588618 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fc051b24-49a2-4b82-bf71-53c17d736933 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1367 microversion: 2.1 time: 0.340706 Aug 08 14:37:30.588757 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 520/1004] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:30 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:30.589871 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 485/1005] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:30 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:30.594427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a218d294-e20d-4c55-9491-e7599c7151a4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:30.594790 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-a218d294-e20d-4c55-9491-e7599c7151a4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:30.605509 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a218d294-e20d-4c55-9491-e7599c7151a4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:30.606082 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a218d294-e20d-4c55-9491-e7599c7151a4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:30.606620 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a218d294-e20d-4c55-9491-e7599c7151a4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:30.607871 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a218d294-e20d-4c55-9491-e7599c7151a4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:30.608410 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a218d294-e20d-4c55-9491-e7599c7151a4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:30.608917 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a218d294-e20d-4c55-9491-e7599c7151a4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:30.752894 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-a218d294-e20d-4c55-9491-e7599c7151a4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:30.765237 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-a218d294-e20d-4c55-9491-e7599c7151a4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:30.766686 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-a218d294-e20d-4c55-9491-e7599c7151a4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:30.767910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-a218d294-e20d-4c55-9491-e7599c7151a4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1739 microversion: 2.20 time: 0.178171 Aug 08 14:37:30.768465 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 521/1006] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:30 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:30.882930 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-0f84a661-8a49-4728-becd-2c39d75ba200 req-faa92d70-e8a1-47cf-bc1d-356431c72e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d8f2558-dee3-46cc-84ef-d11a1133d072", "tag": "935343b7-c1e4-41fe-8066-0a6e99a7578d"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:30.892264 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0f84a661-8a49-4728-becd-2c39d75ba200 req-faa92d70-e8a1-47cf-bc1d-356431c72e15 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:30.892936 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0f84a661-8a49-4728-becd-2c39d75ba200 req-faa92d70-e8a1-47cf-bc1d-356431c72e15 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:30.893380 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0f84a661-8a49-4728-becd-2c39d75ba200 req-faa92d70-e8a1-47cf-bc1d-356431c72e15 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:30.904283 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-0f84a661-8a49-4728-becd-2c39d75ba200 req-faa92d70-e8a1-47cf-bc1d-356431c72e15 service nova] Creating event network-changed:935343b7-c1e4-41fe-8066-0a6e99a7578d for instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 on hv-cinder-85200 Aug 08 14:37:30.910003 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-0f84a661-8a49-4728-becd-2c39d75ba200 req-faa92d70-e8a1-47cf-bc1d-356431c72e15 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030975 Aug 08 14:37:30.910743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 486/1007] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:30.970270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-83b08c4d-88a5-48d0-8685-3bab94d0332c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:30.970816 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-83b08c4d-88a5-48d0-8685-3bab94d0332c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:30.977305 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83b08c4d-88a5-48d0-8685-3bab94d0332c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:30.977789 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83b08c4d-88a5-48d0-8685-3bab94d0332c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:30.978227 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83b08c4d-88a5-48d0-8685-3bab94d0332c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:30.978916 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83b08c4d-88a5-48d0-8685-3bab94d0332c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:30.979394 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83b08c4d-88a5-48d0-8685-3bab94d0332c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:30.979819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-83b08c4d-88a5-48d0-8685-3bab94d0332c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:31.106518 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-83b08c4d-88a5-48d0-8685-3bab94d0332c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:31.113980 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-83b08c4d-88a5-48d0-8685-3bab94d0332c tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1510 microversion: 2.1 time: 0.147667 Aug 08 14:37:31.114544 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 522/1008] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:30 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:31.134341 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5f61d478-abf2-459e-b99a-c1e5d7243b35 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:31.135017 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5f61d478-abf2-459e-b99a-c1e5d7243b35 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:31.141590 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f61d478-abf2-459e-b99a-c1e5d7243b35 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:31.142059 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f61d478-abf2-459e-b99a-c1e5d7243b35 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:31.142488 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f61d478-abf2-459e-b99a-c1e5d7243b35 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:31.143202 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f61d478-abf2-459e-b99a-c1e5d7243b35 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:31.143654 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f61d478-abf2-459e-b99a-c1e5d7243b35 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:31.144071 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f61d478-abf2-459e-b99a-c1e5d7243b35 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:31.173169 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5f61d478-abf2-459e-b99a-c1e5d7243b35 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118060) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 14:37:31.235951 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5f61d478-abf2-459e-b99a-c1e5d7243b35 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "POST /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338/action" status: 202 len: 0 microversion: 2.1 time: 0.105547 Aug 08 14:37:31.236473 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 487/1009] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 14:37:31 2022] POST /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:37:31.244701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5736f7a3-bd37-4fb1-b6a3-92187b52e6a4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:31.245859 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5736f7a3-bd37-4fb1-b6a3-92187b52e6a4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:31.251385 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5736f7a3-bd37-4fb1-b6a3-92187b52e6a4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:31.251870 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5736f7a3-bd37-4fb1-b6a3-92187b52e6a4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:31.252305 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5736f7a3-bd37-4fb1-b6a3-92187b52e6a4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:31.252997 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5736f7a3-bd37-4fb1-b6a3-92187b52e6a4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:31.253455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5736f7a3-bd37-4fb1-b6a3-92187b52e6a4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:31.253879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5736f7a3-bd37-4fb1-b6a3-92187b52e6a4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:31.387058 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-5736f7a3-bd37-4fb1-b6a3-92187b52e6a4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:31.394641 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5736f7a3-bd37-4fb1-b6a3-92187b52e6a4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1518 microversion: 2.1 time: 0.153844 Aug 08 14:37:31.395231 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 523/1010] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:31 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:31.608702 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e3481d60-9db9-4c89-be69-5f668527cab9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:31.609521 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e3481d60-9db9-4c89-be69-5f668527cab9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:31.613281 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-410b17a8-8254-4962-b2f7-c000b9960117 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:31.613897 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-410b17a8-8254-4962-b2f7-c000b9960117 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:31.616708 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e3481d60-9db9-4c89-be69-5f668527cab9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:31.617225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e3481d60-9db9-4c89-be69-5f668527cab9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:31.617664 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e3481d60-9db9-4c89-be69-5f668527cab9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:31.618363 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e3481d60-9db9-4c89-be69-5f668527cab9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:31.618819 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e3481d60-9db9-4c89-be69-5f668527cab9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:31.619284 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e3481d60-9db9-4c89-be69-5f668527cab9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:31.620305 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-410b17a8-8254-4962-b2f7-c000b9960117 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:31.620791 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-410b17a8-8254-4962-b2f7-c000b9960117 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:31.621229 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-410b17a8-8254-4962-b2f7-c000b9960117 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:31.621923 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-410b17a8-8254-4962-b2f7-c000b9960117 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:31.622404 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-410b17a8-8254-4962-b2f7-c000b9960117 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:31.622831 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-410b17a8-8254-4962-b2f7-c000b9960117 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:31.818718 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e3481d60-9db9-4c89-be69-5f668527cab9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:31.821206 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-410b17a8-8254-4962-b2f7-c000b9960117 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:31.826284 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e3481d60-9db9-4c89-be69-5f668527cab9 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.221683 Aug 08 14:37:31.831117 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 488/1011] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:31 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:31.831272 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-410b17a8-8254-4962-b2f7-c000b9960117 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1367 microversion: 2.1 time: 0.219608 Aug 08 14:37:31.831877 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ca1bf024-4538-474b-a4b3-1e2dad7ecb21 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:31.832417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ca1bf024-4538-474b-a4b3-1e2dad7ecb21 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:31.838383 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 524/1012] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:31 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:31.839757 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:31.844111 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ca1bf024-4538-474b-a4b3-1e2dad7ecb21 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:31.844630 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ca1bf024-4538-474b-a4b3-1e2dad7ecb21 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:31.845112 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ca1bf024-4538-474b-a4b3-1e2dad7ecb21 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:31.845808 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ca1bf024-4538-474b-a4b3-1e2dad7ecb21 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:31.846262 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ca1bf024-4538-474b-a4b3-1e2dad7ecb21 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:31.846686 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ca1bf024-4538-474b-a4b3-1e2dad7ecb21 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:31.974079 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ca1bf024-4538-474b-a4b3-1e2dad7ecb21 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:31.982469 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ca1bf024-4538-474b-a4b3-1e2dad7ecb21 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:31.984012 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ca1bf024-4538-474b-a4b3-1e2dad7ecb21 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:31.985159 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ca1bf024-4538-474b-a4b3-1e2dad7ecb21 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1739 microversion: 2.20 time: 0.157061 Aug 08 14:37:31.985712 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 489/1013] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:31 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:32.077636 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3038cf2d-b121-4533-83e7-a8cd7600055d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:32.078127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3038cf2d-b121-4533-83e7-a8cd7600055d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:32.084517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3038cf2d-b121-4533-83e7-a8cd7600055d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:32.084996 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3038cf2d-b121-4533-83e7-a8cd7600055d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:32.085430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3038cf2d-b121-4533-83e7-a8cd7600055d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:32.086122 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3038cf2d-b121-4533-83e7-a8cd7600055d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:32.086573 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3038cf2d-b121-4533-83e7-a8cd7600055d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:32.086998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3038cf2d-b121-4533-83e7-a8cd7600055d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:32.109429 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3038cf2d-b121-4533-83e7-a8cd7600055d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/ips" status: 200 len: 146 microversion: 2.1 time: 0.035667 Aug 08 14:37:32.109972 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 525/1014] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 14:37:32 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:32.416552 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2b070df7-3281-47f6-a745-3e7f63d50c69 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:32.417158 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2b070df7-3281-47f6-a745-3e7f63d50c69 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:32.423417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2b070df7-3281-47f6-a745-3e7f63d50c69 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:32.423895 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2b070df7-3281-47f6-a745-3e7f63d50c69 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:32.424327 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2b070df7-3281-47f6-a745-3e7f63d50c69 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:32.425009 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2b070df7-3281-47f6-a745-3e7f63d50c69 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:32.425454 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2b070df7-3281-47f6-a745-3e7f63d50c69 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:32.425896 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2b070df7-3281-47f6-a745-3e7f63d50c69 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:32.553025 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2b070df7-3281-47f6-a745-3e7f63d50c69 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:32.560370 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2b070df7-3281-47f6-a745-3e7f63d50c69 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1518 microversion: 2.1 time: 0.148418 Aug 08 14:37:32.560932 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 490/1015] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:32 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:32.849214 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5438d334-9b45-47fa-af77-a0007cfb6896 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:32.849476 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-44195df0-f349-4baf-81a1-46c8f2104426 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:32.850449 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5438d334-9b45-47fa-af77-a0007cfb6896 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:32.850566 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-44195df0-f349-4baf-81a1-46c8f2104426 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:32.856224 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5438d334-9b45-47fa-af77-a0007cfb6896 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:32.856704 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5438d334-9b45-47fa-af77-a0007cfb6896 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:32.856822 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-44195df0-f349-4baf-81a1-46c8f2104426 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:32.857133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5438d334-9b45-47fa-af77-a0007cfb6896 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:32.857239 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-44195df0-f349-4baf-81a1-46c8f2104426 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:32.857648 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-44195df0-f349-4baf-81a1-46c8f2104426 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:32.857818 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5438d334-9b45-47fa-af77-a0007cfb6896 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:32.862837 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5438d334-9b45-47fa-af77-a0007cfb6896 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:32.863005 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-44195df0-f349-4baf-81a1-46c8f2104426 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:32.863210 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5438d334-9b45-47fa-af77-a0007cfb6896 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:32.863310 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-44195df0-f349-4baf-81a1-46c8f2104426 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:32.863310 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-44195df0-f349-4baf-81a1-46c8f2104426 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:33.049439 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-44195df0-f349-4baf-81a1-46c8f2104426 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:33.056243 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5438d334-9b45-47fa-af77-a0007cfb6896 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:33.057090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-44195df0-f349-4baf-81a1-46c8f2104426 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.211932 Aug 08 14:37:33.057659 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 526/1016] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:32 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:33.062276 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-11cab5c0-b598-4bab-92ed-87e245192fda tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:33.062881 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-11cab5c0-b598-4bab-92ed-87e245192fda tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:33.064032 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5438d334-9b45-47fa-af77-a0007cfb6896 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1367 microversion: 2.1 time: 0.218733 Aug 08 14:37:33.065688 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 491/1017] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:32 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:33.069468 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11cab5c0-b598-4bab-92ed-87e245192fda tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:33.069959 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11cab5c0-b598-4bab-92ed-87e245192fda tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:33.070399 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11cab5c0-b598-4bab-92ed-87e245192fda tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:33.071110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11cab5c0-b598-4bab-92ed-87e245192fda tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:33.071575 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11cab5c0-b598-4bab-92ed-87e245192fda tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:33.072005 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-11cab5c0-b598-4bab-92ed-87e245192fda tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:33.076008 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:33.203442 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-11cab5c0-b598-4bab-92ed-87e245192fda tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:33.211903 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-11cab5c0-b598-4bab-92ed-87e245192fda tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:33.213484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-11cab5c0-b598-4bab-92ed-87e245192fda tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:33.214646 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-11cab5c0-b598-4bab-92ed-87e245192fda tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1739 microversion: 2.20 time: 0.156068 Aug 08 14:37:33.215255 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 527/1018] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:33 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:33.424713 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-31ef6c19-27a8-4e13-8ef1-244daf73bda8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0c52b0c-9e3a-4752-8f0b-d71603aa7149"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:33.427115 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-31ef6c19-27a8-4e13-8ef1-244daf73bda8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:33.433958 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31ef6c19-27a8-4e13-8ef1-244daf73bda8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:33.434433 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31ef6c19-27a8-4e13-8ef1-244daf73bda8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:33.434861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31ef6c19-27a8-4e13-8ef1-244daf73bda8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:33.435576 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31ef6c19-27a8-4e13-8ef1-244daf73bda8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:33.436018 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31ef6c19-27a8-4e13-8ef1-244daf73bda8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:33.436436 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31ef6c19-27a8-4e13-8ef1-244daf73bda8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:33.581135 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4d7f7e21-92a4-4dd3-b1a7-9a820a840e34 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:33.581743 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-4d7f7e21-92a4-4dd3-b1a7-9a820a840e34 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:33.587723 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4d7f7e21-92a4-4dd3-b1a7-9a820a840e34 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:33.588195 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4d7f7e21-92a4-4dd3-b1a7-9a820a840e34 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:33.588626 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4d7f7e21-92a4-4dd3-b1a7-9a820a840e34 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:33.589307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4d7f7e21-92a4-4dd3-b1a7-9a820a840e34 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:33.589758 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4d7f7e21-92a4-4dd3-b1a7-9a820a840e34 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:33.590177 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4d7f7e21-92a4-4dd3-b1a7-9a820a840e34 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:33.730956 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4d7f7e21-92a4-4dd3-b1a7-9a820a840e34 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:33.742400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-4d7f7e21-92a4-4dd3-b1a7-9a820a840e34 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1518 microversion: 2.1 time: 0.165004 Aug 08 14:37:33.742982 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 528/1019] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:33 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:34.077863 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f525a8bf-211b-4932-9692-7db3aa667d2d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:34.078513 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f525a8bf-211b-4932-9692-7db3aa667d2d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:34.085512 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f525a8bf-211b-4932-9692-7db3aa667d2d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:34.086003 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f525a8bf-211b-4932-9692-7db3aa667d2d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:34.086439 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f525a8bf-211b-4932-9692-7db3aa667d2d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:34.087164 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f525a8bf-211b-4932-9692-7db3aa667d2d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:34.087627 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f525a8bf-211b-4932-9692-7db3aa667d2d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:34.088055 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f525a8bf-211b-4932-9692-7db3aa667d2d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:34.291121 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f525a8bf-211b-4932-9692-7db3aa667d2d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:34.298911 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f525a8bf-211b-4932-9692-7db3aa667d2d tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1522 microversion: 2.1 time: 0.225029 Aug 08 14:37:34.299495 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 529/1020] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:34 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:34.307427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-84659920-ad7f-4de7-a35b-3c66d427be2b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:34.307427 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-84659920-ad7f-4de7-a35b-3c66d427be2b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:34.311187 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-84659920-ad7f-4de7-a35b-3c66d427be2b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:34.311787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-84659920-ad7f-4de7-a35b-3c66d427be2b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:34.312406 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-84659920-ad7f-4de7-a35b-3c66d427be2b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:34.313111 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-84659920-ad7f-4de7-a35b-3c66d427be2b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:34.313588 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-84659920-ad7f-4de7-a35b-3c66d427be2b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:34.314146 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-84659920-ad7f-4de7-a35b-3c66d427be2b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:34.378856 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-31ef6c19-27a8-4e13-8ef1-244daf73bda8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "POST /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.955461 Aug 08 14:37:34.379547 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 492/1021] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 14:37:33 2022] POST /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments => generated 194 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:34.392582 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-01d18e62-8f45-42b9-825e-56b819703cb2 req-be53eede-4365-45fa-8d07-68c749ecb158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eff17af-e081-4582-82fb-ba2f7a45c338", "name": "network-vif-unplugged", "status": "completed", "tag": "54289b72-3379-4dba-9ae7-835b040e581b"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:34.408053 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-01d18e62-8f45-42b9-825e-56b819703cb2 req-be53eede-4365-45fa-8d07-68c749ecb158 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:34.410731 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-01d18e62-8f45-42b9-825e-56b819703cb2 req-be53eede-4365-45fa-8d07-68c749ecb158 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:34.412014 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-01d18e62-8f45-42b9-825e-56b819703cb2 req-be53eede-4365-45fa-8d07-68c749ecb158 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:34.427327 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.compute.server_external_events [req-01d18e62-8f45-42b9-825e-56b819703cb2 req-be53eede-4365-45fa-8d07-68c749ecb158 service nova] Unable to find a host for instance 0eff17af-e081-4582-82fb-ba2f7a45c338. Dropping event network-vif-unplugged {{(pid=118060) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 08 14:37:34.429443 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-01d18e62-8f45-42b9-825e-56b819703cb2 req-be53eede-4365-45fa-8d07-68c749ecb158 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040955 Aug 08 14:37:34.435113 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 493/1022] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 08 14:37:34.442034 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f8ba8047-584e-4a15-9a8f-9d4af625d2d6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:34.443806 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f8ba8047-584e-4a15-9a8f-9d4af625d2d6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:34.451773 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8ba8047-584e-4a15-9a8f-9d4af625d2d6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:34.452270 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8ba8047-584e-4a15-9a8f-9d4af625d2d6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:34.452715 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8ba8047-584e-4a15-9a8f-9d4af625d2d6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:34.453425 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8ba8047-584e-4a15-9a8f-9d4af625d2d6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:34.454145 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8ba8047-584e-4a15-9a8f-9d4af625d2d6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:34.454483 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8ba8047-584e-4a15-9a8f-9d4af625d2d6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:34.487191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:34.676520 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-84659920-ad7f-4de7-a35b-3c66d427be2b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:34.685383 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-84659920-ad7f-4de7-a35b-3c66d427be2b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1367 microversion: 2.1 time: 0.384670 Aug 08 14:37:34.686675 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 530/1023] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:34 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:34.765857 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c76e518f-bed3-4b1a-bd6c-d83c8979109f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:34.767740 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c76e518f-bed3-4b1a-bd6c-d83c8979109f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:34.777529 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f8ba8047-584e-4a15-9a8f-9d4af625d2d6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:34.800193 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c76e518f-bed3-4b1a-bd6c-d83c8979109f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:34.800982 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c76e518f-bed3-4b1a-bd6c-d83c8979109f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:34.801592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c76e518f-bed3-4b1a-bd6c-d83c8979109f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:34.803019 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c76e518f-bed3-4b1a-bd6c-d83c8979109f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:34.803180 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f8ba8047-584e-4a15-9a8f-9d4af625d2d6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:34.805046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f8ba8047-584e-4a15-9a8f-9d4af625d2d6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:34.805740 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c76e518f-bed3-4b1a-bd6c-d83c8979109f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:34.806360 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c76e518f-bed3-4b1a-bd6c-d83c8979109f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:34.812740 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f8ba8047-584e-4a15-9a8f-9d4af625d2d6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1721 microversion: 2.20 time: 0.376329 Aug 08 14:37:34.814484 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 494/1024] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:34 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1721 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:35.255767 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-f8341e66-5063-408e-9885-0c65ae9876b9 req-733b935e-2170-406b-a692-6ecb53711774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f83a0c-1b6f-446f-96d5-804d508e2cf9", "name": "network-vif-deleted", "tag": "d2377ba9-ace6-4a33-8019-7093cab3996e"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:35.265879 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-f8341e66-5063-408e-9885-0c65ae9876b9 req-733b935e-2170-406b-a692-6ecb53711774 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:35.266377 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-f8341e66-5063-408e-9885-0c65ae9876b9 req-733b935e-2170-406b-a692-6ecb53711774 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:35.266823 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-f8341e66-5063-408e-9885-0c65ae9876b9 req-733b935e-2170-406b-a692-6ecb53711774 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:35.272280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-c76e518f-bed3-4b1a-bd6c-d83c8979109f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:35.278487 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-f8341e66-5063-408e-9885-0c65ae9876b9 req-733b935e-2170-406b-a692-6ecb53711774 service nova] Creating event network-vif-deleted:d2377ba9-ace6-4a33-8019-7093cab3996e for instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 on hv-cinder-85200 Aug 08 14:37:35.280912 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c76e518f-bed3-4b1a-bd6c-d83c8979109f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1520 microversion: 2.1 time: 0.521226 Aug 08 14:37:35.281480 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 531/1025] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:34 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1520 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:35.285016 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-f8341e66-5063-408e-9885-0c65ae9876b9 req-733b935e-2170-406b-a692-6ecb53711774 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032909 Aug 08 14:37:35.285597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 495/1026] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:37:35.325072 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-03aa9262-a397-4c84-9f49-bd04c5a8dacb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:35.325687 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-03aa9262-a397-4c84-9f49-bd04c5a8dacb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:35.331621 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-03aa9262-a397-4c84-9f49-bd04c5a8dacb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:35.332111 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-03aa9262-a397-4c84-9f49-bd04c5a8dacb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:35.332553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-03aa9262-a397-4c84-9f49-bd04c5a8dacb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:35.333249 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-03aa9262-a397-4c84-9f49-bd04c5a8dacb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:35.334400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-03aa9262-a397-4c84-9f49-bd04c5a8dacb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:35.334834 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-03aa9262-a397-4c84-9f49-bd04c5a8dacb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:35.397576 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-03aa9262-a397-4c84-9f49-bd04c5a8dacb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:35.405030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-03aa9262-a397-4c84-9f49-bd04c5a8dacb tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1480 microversion: 2.1 time: 0.083856 Aug 08 14:37:35.405834 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 532/1027] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:35 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1480 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:35.706258 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7db65a22-9775-470b-92cb-48ab7f1c8062 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:35.706951 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7db65a22-9775-470b-92cb-48ab7f1c8062 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:35.709045 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:35.714656 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7db65a22-9775-470b-92cb-48ab7f1c8062 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:35.715272 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7db65a22-9775-470b-92cb-48ab7f1c8062 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:35.715710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7db65a22-9775-470b-92cb-48ab7f1c8062 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:35.716416 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7db65a22-9775-470b-92cb-48ab7f1c8062 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:35.716862 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7db65a22-9775-470b-92cb-48ab7f1c8062 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:35.717282 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7db65a22-9775-470b-92cb-48ab7f1c8062 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:35.785040 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=12 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:35.840443 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-00ed61ea-2f40-4ef4-ba01-3aa3b77a3fc4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:35.841064 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-00ed61ea-2f40-4ef4-ba01-3aa3b77a3fc4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:35.847445 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-00ed61ea-2f40-4ef4-ba01-3aa3b77a3fc4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:35.847951 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-00ed61ea-2f40-4ef4-ba01-3aa3b77a3fc4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:35.848387 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-00ed61ea-2f40-4ef4-ba01-3aa3b77a3fc4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:35.849400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-00ed61ea-2f40-4ef4-ba01-3aa3b77a3fc4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:35.849861 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-00ed61ea-2f40-4ef4-ba01-3aa3b77a3fc4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:35.850676 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-00ed61ea-2f40-4ef4-ba01-3aa3b77a3fc4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:35.853353 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7db65a22-9775-470b-92cb-48ab7f1c8062 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:35.872034 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7db65a22-9775-470b-92cb-48ab7f1c8062 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1367 microversion: 2.1 time: 0.169843 Aug 08 14:37:35.877781 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 496/1028] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:35 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:35.992976 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-00ed61ea-2f40-4ef4-ba01-3aa3b77a3fc4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:36.001109 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-00ed61ea-2f40-4ef4-ba01-3aa3b77a3fc4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:36.002648 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-00ed61ea-2f40-4ef4-ba01-3aa3b77a3fc4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:36.003842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-00ed61ea-2f40-4ef4-ba01-3aa3b77a3fc4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1721 microversion: 2.20 time: 0.168046 Aug 08 14:37:36.004403 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 533/1029] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:35 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:36.302905 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-cf2fc225-cfb0-4b55-8d83-ba044c9c0fde tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:36.303551 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-cf2fc225-cfb0-4b55-8d83-ba044c9c0fde tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:36.309860 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cf2fc225-cfb0-4b55-8d83-ba044c9c0fde tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:36.310326 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cf2fc225-cfb0-4b55-8d83-ba044c9c0fde tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:36.310762 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cf2fc225-cfb0-4b55-8d83-ba044c9c0fde tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:36.311484 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cf2fc225-cfb0-4b55-8d83-ba044c9c0fde tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:36.311938 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cf2fc225-cfb0-4b55-8d83-ba044c9c0fde tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:36.312363 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cf2fc225-cfb0-4b55-8d83-ba044c9c0fde tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:36.425722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-23e60d79-3629-4c78-8353-1c6b28ade5bd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:36.426239 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-23e60d79-3629-4c78-8353-1c6b28ade5bd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:36.432682 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23e60d79-3629-4c78-8353-1c6b28ade5bd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:36.433166 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23e60d79-3629-4c78-8353-1c6b28ade5bd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:36.433604 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23e60d79-3629-4c78-8353-1c6b28ade5bd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:36.434297 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23e60d79-3629-4c78-8353-1c6b28ade5bd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:36.434758 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23e60d79-3629-4c78-8353-1c6b28ade5bd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:36.435218 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23e60d79-3629-4c78-8353-1c6b28ade5bd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:36.443500 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-cf2fc225-cfb0-4b55-8d83-ba044c9c0fde tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:36.450956 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-cf2fc225-cfb0-4b55-8d83-ba044c9c0fde tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.151928 Aug 08 14:37:36.451554 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 497/1030] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:36 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:36.467459 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23e60d79-3629-4c78-8353-1c6b28ade5bd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:36.467937 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23e60d79-3629-4c78-8353-1c6b28ade5bd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:36.468372 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-23e60d79-3629-4c78-8353-1c6b28ade5bd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:36.468810 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-23e60d79-3629-4c78-8353-1c6b28ade5bd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lazy-loading 'fault' on Instance uuid e9f83a0c-1b6f-446f-96d5-804d508e2cf9 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:37:36.508794 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-23e60d79-3629-4c78-8353-1c6b28ade5bd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:36.516001 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-23e60d79-3629-4c78-8353-1c6b28ade5bd tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1312 microversion: 2.1 time: 0.094183 Aug 08 14:37:36.516554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 534/1031] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:36 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:36.899514 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5e00a594-e391-42ae-b557-ef217700aa67 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:36.900122 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5e00a594-e391-42ae-b557-ef217700aa67 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:36.906080 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e00a594-e391-42ae-b557-ef217700aa67 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:36.906556 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e00a594-e391-42ae-b557-ef217700aa67 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:36.906987 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e00a594-e391-42ae-b557-ef217700aa67 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:36.907713 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e00a594-e391-42ae-b557-ef217700aa67 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:36.908160 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e00a594-e391-42ae-b557-ef217700aa67 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:36.908580 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e00a594-e391-42ae-b557-ef217700aa67 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:37.025820 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7d14b581-9a40-4e82-9ae7-433403a25c35 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:37.026425 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7d14b581-9a40-4e82-9ae7-433403a25c35 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:37.032641 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d14b581-9a40-4e82-9ae7-433403a25c35 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:37.033087 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d14b581-9a40-4e82-9ae7-433403a25c35 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:37.033527 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d14b581-9a40-4e82-9ae7-433403a25c35 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:37.034225 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d14b581-9a40-4e82-9ae7-433403a25c35 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:37.034681 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d14b581-9a40-4e82-9ae7-433403a25c35 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:37.034952 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5e00a594-e391-42ae-b557-ef217700aa67 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:37.035131 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7d14b581-9a40-4e82-9ae7-433403a25c35 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:37.042533 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5e00a594-e391-42ae-b557-ef217700aa67 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1367 microversion: 2.1 time: 0.147529 Aug 08 14:37:37.043119 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 498/1032] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:36 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:37.163446 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7d14b581-9a40-4e82-9ae7-433403a25c35 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:37.171524 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7d14b581-9a40-4e82-9ae7-433403a25c35 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:37.173042 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7d14b581-9a40-4e82-9ae7-433403a25c35 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:37.174182 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7d14b581-9a40-4e82-9ae7-433403a25c35 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1721 microversion: 2.20 time: 0.152326 Aug 08 14:37:37.174737 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 535/1033] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:37 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:37.472641 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-624eaa5f-2b4a-46b6-a20d-3f5e730f08bc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:37.473181 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-624eaa5f-2b4a-46b6-a20d-3f5e730f08bc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:37.479973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-624eaa5f-2b4a-46b6-a20d-3f5e730f08bc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:37.480451 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-624eaa5f-2b4a-46b6-a20d-3f5e730f08bc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:37.480881 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-624eaa5f-2b4a-46b6-a20d-3f5e730f08bc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:37.481568 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-624eaa5f-2b4a-46b6-a20d-3f5e730f08bc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:37.482017 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-624eaa5f-2b4a-46b6-a20d-3f5e730f08bc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:37.482432 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-624eaa5f-2b4a-46b6-a20d-3f5e730f08bc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:37.537280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d6a8cfd5-62cb-45f5-b338-d9722c7ea65b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:37.537908 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d6a8cfd5-62cb-45f5-b338-d9722c7ea65b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:37.544307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6a8cfd5-62cb-45f5-b338-d9722c7ea65b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:37.544790 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6a8cfd5-62cb-45f5-b338-d9722c7ea65b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:37.545258 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6a8cfd5-62cb-45f5-b338-d9722c7ea65b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:37.545955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6a8cfd5-62cb-45f5-b338-d9722c7ea65b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:37.546413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6a8cfd5-62cb-45f5-b338-d9722c7ea65b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:37.546838 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6a8cfd5-62cb-45f5-b338-d9722c7ea65b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:37.579504 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6a8cfd5-62cb-45f5-b338-d9722c7ea65b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:37.579990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6a8cfd5-62cb-45f5-b338-d9722c7ea65b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:37.580428 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d6a8cfd5-62cb-45f5-b338-d9722c7ea65b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:37.580876 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-d6a8cfd5-62cb-45f5-b338-d9722c7ea65b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lazy-loading 'fault' on Instance uuid e9f83a0c-1b6f-446f-96d5-804d508e2cf9 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:37:37.667836 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d6a8cfd5-62cb-45f5-b338-d9722c7ea65b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d373dfa8c474ade92e94dc73dd9926f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecb83fbcae94dca82331ab87f028878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:37.680584 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d6a8cfd5-62cb-45f5-b338-d9722c7ea65b tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 200 len: 1312 microversion: 2.1 time: 0.147398 Aug 08 14:37:37.682725 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 536/1034] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:37 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:37.708711 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-624eaa5f-2b4a-46b6-a20d-3f5e730f08bc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:37.717722 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-624eaa5f-2b4a-46b6-a20d-3f5e730f08bc tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.249288 Aug 08 14:37:37.718303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 499/1035] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:37 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:38.062965 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bc3d2738-2e74-4e79-a83b-036229398613 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:38.063530 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bc3d2738-2e74-4e79-a83b-036229398613 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:38.069459 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bc3d2738-2e74-4e79-a83b-036229398613 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:38.069937 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bc3d2738-2e74-4e79-a83b-036229398613 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:38.070376 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bc3d2738-2e74-4e79-a83b-036229398613 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:38.071060 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bc3d2738-2e74-4e79-a83b-036229398613 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:38.071534 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bc3d2738-2e74-4e79-a83b-036229398613 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:38.071956 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bc3d2738-2e74-4e79-a83b-036229398613 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:38.196822 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-0ab92657-3685-4827-a3dd-13ab70cd47b1 req-09574f23-ee9d-43f9-babc-a90012d5b507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79aaf7b-bbdb-42b5-a337-89102612ff93", "name": "network-vif-unplugged", "status": "completed", "tag": "9bfd7cef-c545-4cf2-8212-293910501379"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:38.204925 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bc3d2738-2e74-4e79-a83b-036229398613 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:38.207157 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0ab92657-3685-4827-a3dd-13ab70cd47b1 req-09574f23-ee9d-43f9-babc-a90012d5b507 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:38.207829 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0ab92657-3685-4827-a3dd-13ab70cd47b1 req-09574f23-ee9d-43f9-babc-a90012d5b507 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:38.208314 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0ab92657-3685-4827-a3dd-13ab70cd47b1 req-09574f23-ee9d-43f9-babc-a90012d5b507 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:38.215845 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bc3d2738-2e74-4e79-a83b-036229398613 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1367 microversion: 2.1 time: 0.156767 Aug 08 14:37:38.219316 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 537/1036] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:38 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:38.221343 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2ecb89b9-3ecb-4da9-91eb-54307dccfafa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:38.221951 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2ecb89b9-3ecb-4da9-91eb-54307dccfafa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:38.222192 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-0ab92657-3685-4827-a3dd-13ab70cd47b1 req-09574f23-ee9d-43f9-babc-a90012d5b507 service nova] Creating event network-vif-unplugged:9bfd7cef-c545-4cf2-8212-293910501379 for instance c79aaf7b-bbdb-42b5-a337-89102612ff93 on hv-cinder-85200 Aug 08 14:37:38.227588 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-0ab92657-3685-4827-a3dd-13ab70cd47b1 req-09574f23-ee9d-43f9-babc-a90012d5b507 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035639 Aug 08 14:37:38.228636 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 500/1037] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:37:38.229097 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2ecb89b9-3ecb-4da9-91eb-54307dccfafa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:38.229830 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2ecb89b9-3ecb-4da9-91eb-54307dccfafa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:38.230371 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2ecb89b9-3ecb-4da9-91eb-54307dccfafa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:38.231177 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2ecb89b9-3ecb-4da9-91eb-54307dccfafa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:38.231714 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2ecb89b9-3ecb-4da9-91eb-54307dccfafa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:38.232213 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2ecb89b9-3ecb-4da9-91eb-54307dccfafa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:38.361367 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2ecb89b9-3ecb-4da9-91eb-54307dccfafa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:38.369213 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2ecb89b9-3ecb-4da9-91eb-54307dccfafa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:38.370746 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2ecb89b9-3ecb-4da9-91eb-54307dccfafa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:38.371949 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2ecb89b9-3ecb-4da9-91eb-54307dccfafa tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1721 microversion: 2.20 time: 0.154504 Aug 08 14:37:38.372504 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 538/1038] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:38 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:38.702219 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c19295a1-d05a-45f0-b43d-d50ca3ac3af6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:38.702907 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c19295a1-d05a-45f0-b43d-d50ca3ac3af6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] [instance: e9f83a0c-1b6f-446f-96d5-804d508e2cf9] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:38.708979 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c19295a1-d05a-45f0-b43d-d50ca3ac3af6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:38.709457 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c19295a1-d05a-45f0-b43d-d50ca3ac3af6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:38.709891 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c19295a1-d05a-45f0-b43d-d50ca3ac3af6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:38.710585 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c19295a1-d05a-45f0-b43d-d50ca3ac3af6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:38.711036 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c19295a1-d05a-45f0-b43d-d50ca3ac3af6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:38.711478 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c19295a1-d05a-45f0-b43d-d50ca3ac3af6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:38.724485 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-c19295a1-d05a-45f0-b43d-d50ca3ac3af6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] HTTP exception thrown: Instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 could not be found. Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c19295a1-d05a-45f0-b43d-d50ca3ac3af6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Request method failure captured: Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 HTTP/1.1 Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R57J81LntT0wnBLoq0gsHuTcdb_gHa2boWqNwcHJNT7GzMY0xQaN4u9gbPeQMkc14SBA7jeP_d07iW79RHlaNziPk2GWGa1BYt-GMeY3VrGnZvm8TtxiX0dmqfpjGqGooMq0e11KFxasfjzOL609Nmftln0YBM8XLy3f2h8GasueEo Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 6ecb83fbcae94dca82331ab87f028878 Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:37:38.726195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:37:38.727847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6ecb83fbcae94dca82331ab87f028878"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6ecb83fbcae94dca82331ab87f028878", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ecb83fbcae94dca82331ab87f028878"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ecb83fbcae94dca82331ab87f028878"}]}] Aug 08 14:37:38.727847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:37:38.727847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 6ecb83fbcae94dca82331ab87f028878 Aug 08 14:37:38.727847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1730375856 Aug 08 14:37:38.727847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-ServerRescueNegativeTestJSON-1730375856-project Aug 08 14:37:38.727847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:37:38.727847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:37:38.727847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 7d373dfa8c474ade92e94dc73dd9926f Aug 08 14:37:38.727847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1730375856-project Aug 08 14:37:38.727847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:37:38.727847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 could not be found. Aug 08 14:37:38.727847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'e9f83a0c-1b6f-446f-96d5-804d508e2cf9'} Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 could not be found. Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:37:38.728612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 could not be found. Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 could not be found. Aug 08 14:37:38.729844 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:38.730895 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c19295a1-d05a-45f0-b43d-d50ca3ac3af6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] Returning 404 to user: Instance e9f83a0c-1b6f-446f-96d5-804d508e2cf9 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:37:38.730895 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c19295a1-d05a-45f0-b43d-d50ca3ac3af6 tempest-ServerRescueNegativeTestJSON-1730375856 tempest-ServerRescueNegativeTestJSON-1730375856-project] 10.222.0.50 "GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9" status: 404 len: 111 microversion: 2.1 time: 0.030123 Aug 08 14:37:38.730895 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 501/1039] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:38 2022] GET /compute/v2.1/servers/e9f83a0c-1b6f-446f-96d5-804d508e2cf9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:37:38.739189 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-fa79f716-4549-4074-bf10-7d009dd7b18f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:38.740932 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-fa79f716-4549-4074-bf10-7d009dd7b18f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:38.748430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fa79f716-4549-4074-bf10-7d009dd7b18f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:38.748948 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fa79f716-4549-4074-bf10-7d009dd7b18f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:38.749384 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fa79f716-4549-4074-bf10-7d009dd7b18f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:38.750083 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fa79f716-4549-4074-bf10-7d009dd7b18f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:38.750534 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fa79f716-4549-4074-bf10-7d009dd7b18f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:38.750960 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fa79f716-4549-4074-bf10-7d009dd7b18f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:38.895451 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-fa79f716-4549-4074-bf10-7d009dd7b18f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:38.903408 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-fa79f716-4549-4074-bf10-7d009dd7b18f tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.168016 Aug 08 14:37:38.904203 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 539/1040] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:38 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:39.237260 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1f184655-bc43-4de1-bbf1-36788919c78a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:39.237872 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1f184655-bc43-4de1-bbf1-36788919c78a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:39.244392 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f184655-bc43-4de1-bbf1-36788919c78a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:39.244867 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f184655-bc43-4de1-bbf1-36788919c78a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:39.245300 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f184655-bc43-4de1-bbf1-36788919c78a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:39.245984 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f184655-bc43-4de1-bbf1-36788919c78a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:39.246432 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f184655-bc43-4de1-bbf1-36788919c78a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:39.246851 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1f184655-bc43-4de1-bbf1-36788919c78a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:39.374982 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1f184655-bc43-4de1-bbf1-36788919c78a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:39.382530 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1f184655-bc43-4de1-bbf1-36788919c78a tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1367 microversion: 2.1 time: 0.149159 Aug 08 14:37:39.383110 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 502/1041] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:39 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:39.395426 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-957faaaa-bc79-4ffb-b7c7-562492eab91c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:39.396623 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-957faaaa-bc79-4ffb-b7c7-562492eab91c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:39.402522 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-957faaaa-bc79-4ffb-b7c7-562492eab91c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:39.402940 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-957faaaa-bc79-4ffb-b7c7-562492eab91c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:39.403414 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-957faaaa-bc79-4ffb-b7c7-562492eab91c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:39.404110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-957faaaa-bc79-4ffb-b7c7-562492eab91c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:39.404573 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-957faaaa-bc79-4ffb-b7c7-562492eab91c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:39.405115 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-957faaaa-bc79-4ffb-b7c7-562492eab91c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:39.533040 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-957faaaa-bc79-4ffb-b7c7-562492eab91c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:39.541803 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-957faaaa-bc79-4ffb-b7c7-562492eab91c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:39.543356 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-957faaaa-bc79-4ffb-b7c7-562492eab91c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:39.544513 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-957faaaa-bc79-4ffb-b7c7-562492eab91c tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1664 microversion: 2.20 time: 0.153205 Aug 08 14:37:39.545070 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 540/1042] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:39 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:39.566591 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7a900bd0-d244-461f-a746-f481c8dfa886 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9acc9203-6a4b-4371-8dfa-fb6eb8c9d6bf"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:39.569008 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7a900bd0-d244-461f-a746-f481c8dfa886 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:39.574857 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7a900bd0-d244-461f-a746-f481c8dfa886 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:39.575485 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7a900bd0-d244-461f-a746-f481c8dfa886 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:39.575948 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7a900bd0-d244-461f-a746-f481c8dfa886 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:39.576774 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7a900bd0-d244-461f-a746-f481c8dfa886 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:39.577188 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7a900bd0-d244-461f-a746-f481c8dfa886 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:39.577802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7a900bd0-d244-461f-a746-f481c8dfa886 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:39.861859 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7a900bd0-d244-461f-a746-f481c8dfa886 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "POST /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299066 Aug 08 14:37:39.862811 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 503/1043] 10.222.0.50 () {62 vars in 1364 bytes} [Mon Aug 8 14:37:39 2022] POST /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 14:37:39.935076 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1893396e-e65c-453f-a43f-79ccec24f524 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:39.936363 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1893396e-e65c-453f-a43f-79ccec24f524 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:39.944037 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1893396e-e65c-453f-a43f-79ccec24f524 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:39.944709 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1893396e-e65c-453f-a43f-79ccec24f524 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:39.945527 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1893396e-e65c-453f-a43f-79ccec24f524 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:39.946421 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1893396e-e65c-453f-a43f-79ccec24f524 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:39.946885 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1893396e-e65c-453f-a43f-79ccec24f524 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:39.947333 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1893396e-e65c-453f-a43f-79ccec24f524 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:40.006781 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f405dcd1-02e7-4d70-965d-1baaad6bb8d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:40.007427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f405dcd1-02e7-4d70-965d-1baaad6bb8d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:40.013539 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f405dcd1-02e7-4d70-965d-1baaad6bb8d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:40.014134 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f405dcd1-02e7-4d70-965d-1baaad6bb8d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:40.014670 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f405dcd1-02e7-4d70-965d-1baaad6bb8d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:40.015500 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f405dcd1-02e7-4d70-965d-1baaad6bb8d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:40.016050 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f405dcd1-02e7-4d70-965d-1baaad6bb8d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:40.016573 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f405dcd1-02e7-4d70-965d-1baaad6bb8d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:40.108599 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-1893396e-e65c-453f-a43f-79ccec24f524 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:40.118035 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1893396e-e65c-453f-a43f-79ccec24f524 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.186924 Aug 08 14:37:40.118612 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 541/1044] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:39 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:40.305035 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f405dcd1-02e7-4d70-965d-1baaad6bb8d2 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93/os-volume_attachments/9acc9203-6a4b-4371-8dfa-fb6eb8c9d6bf" status: 202 len: 0 microversion: 2.20 time: 0.302681 Aug 08 14:37:40.306559 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 504/1045] 10.222.0.50 () {60 vars in 1457 bytes} [Mon Aug 8 14:37:40 2022] DELETE /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93/os-volume_attachments/9acc9203-6a4b-4371-8dfa-fb6eb8c9d6bf => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 08 14:37:40.376029 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3b0de041-8e5d-47a7-a068-13232b84b007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:40.376627 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3b0de041-8e5d-47a7-a068-13232b84b007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:40.383602 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3b0de041-8e5d-47a7-a068-13232b84b007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:40.384214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3b0de041-8e5d-47a7-a068-13232b84b007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:40.384673 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3b0de041-8e5d-47a7-a068-13232b84b007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:40.385421 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3b0de041-8e5d-47a7-a068-13232b84b007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:40.386054 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3b0de041-8e5d-47a7-a068-13232b84b007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:40.386643 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3b0de041-8e5d-47a7-a068-13232b84b007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:40.402121 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-440ac24f-904b-40a6-b702-053d7fdff260 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:40.402960 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-440ac24f-904b-40a6-b702-053d7fdff260 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:40.409281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-440ac24f-904b-40a6-b702-053d7fdff260 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:40.409953 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-440ac24f-904b-40a6-b702-053d7fdff260 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:40.410586 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-440ac24f-904b-40a6-b702-053d7fdff260 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:40.412375 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-440ac24f-904b-40a6-b702-053d7fdff260 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:40.413004 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-440ac24f-904b-40a6-b702-053d7fdff260 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:40.413607 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-440ac24f-904b-40a6-b702-053d7fdff260 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:40.444695 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3b0de041-8e5d-47a7-a068-13232b84b007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118062) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 14:37:40.487110 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=100 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:40.525559 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3b0de041-8e5d-47a7-a068-13232b84b007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "POST /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93/action" status: 202 len: 0 microversion: 2.20 time: 0.154526 Aug 08 14:37:40.526579 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 542/1046] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Aug 8 14:37:40 2022] POST /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 08 14:37:40.534402 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-244351a5-9451-4340-ba5b-25ae8e44fcbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:40.535190 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-244351a5-9451-4340-ba5b-25ae8e44fcbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:40.546577 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-244351a5-9451-4340-ba5b-25ae8e44fcbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:40.547894 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-244351a5-9451-4340-ba5b-25ae8e44fcbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:40.548428 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-244351a5-9451-4340-ba5b-25ae8e44fcbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:40.549312 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-244351a5-9451-4340-ba5b-25ae8e44fcbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:40.549924 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-244351a5-9451-4340-ba5b-25ae8e44fcbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:40.550537 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-244351a5-9451-4340-ba5b-25ae8e44fcbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:40.726861 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-440ac24f-904b-40a6-b702-053d7fdff260 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:40.735397 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-440ac24f-904b-40a6-b702-053d7fdff260 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1367 microversion: 2.1 time: 0.336999 Aug 08 14:37:40.736813 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 505/1047] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:40 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:40.785367 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-244351a5-9451-4340-ba5b-25ae8e44fcbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:40.801238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-244351a5-9451-4340-ba5b-25ae8e44fcbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:40.816642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-244351a5-9451-4340-ba5b-25ae8e44fcbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:40.820099 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-244351a5-9451-4340-ba5b-25ae8e44fcbc tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1672 microversion: 2.20 time: 0.289539 Aug 08 14:37:40.839438 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 543/1048] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:40 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1672 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:41.139755 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-66517a43-13d4-4a9a-a1ae-ab1920faeff6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:41.140755 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-66517a43-13d4-4a9a-a1ae-ab1920faeff6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:41.152336 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-66517a43-13d4-4a9a-a1ae-ab1920faeff6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:41.152975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-66517a43-13d4-4a9a-a1ae-ab1920faeff6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:41.153356 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-66517a43-13d4-4a9a-a1ae-ab1920faeff6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:41.154200 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-66517a43-13d4-4a9a-a1ae-ab1920faeff6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:41.154872 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-66517a43-13d4-4a9a-a1ae-ab1920faeff6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:41.155161 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-66517a43-13d4-4a9a-a1ae-ab1920faeff6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:41.441004 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-66517a43-13d4-4a9a-a1ae-ab1920faeff6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:41.452226 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-66517a43-13d4-4a9a-a1ae-ab1920faeff6 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.316311 Aug 08 14:37:41.452847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 506/1049] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:41 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:41.758321 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-79ccec78-cde9-4081-b495-25e2fdba605b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:41.759565 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-79ccec78-cde9-4081-b495-25e2fdba605b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:41.766193 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-79ccec78-cde9-4081-b495-25e2fdba605b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:41.766912 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-79ccec78-cde9-4081-b495-25e2fdba605b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:41.767523 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-79ccec78-cde9-4081-b495-25e2fdba605b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:41.768373 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-79ccec78-cde9-4081-b495-25e2fdba605b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:41.769356 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-79ccec78-cde9-4081-b495-25e2fdba605b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:41.769664 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-79ccec78-cde9-4081-b495-25e2fdba605b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:41.850470 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-31e6bbfb-bc5e-47af-b9c1-3075c813d6bf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:41.851056 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-31e6bbfb-bc5e-47af-b9c1-3075c813d6bf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:41.862662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31e6bbfb-bc5e-47af-b9c1-3075c813d6bf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:41.863195 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31e6bbfb-bc5e-47af-b9c1-3075c813d6bf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:41.863637 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31e6bbfb-bc5e-47af-b9c1-3075c813d6bf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:41.864359 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31e6bbfb-bc5e-47af-b9c1-3075c813d6bf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:41.865359 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31e6bbfb-bc5e-47af-b9c1-3075c813d6bf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:41.870855 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31e6bbfb-bc5e-47af-b9c1-3075c813d6bf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:41.922259 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:42.087886 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-79ccec78-cde9-4081-b495-25e2fdba605b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:42.103788 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-79ccec78-cde9-4081-b495-25e2fdba605b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1367 microversion: 2.1 time: 0.343689 Aug 08 14:37:42.118407 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 544/1050] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:41 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:42.123827 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b77be3ab-9019-42fd-a80b-0b206dd52177 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:42.127394 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b77be3ab-9019-42fd-a80b-0b206dd52177 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:42.135338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b77be3ab-9019-42fd-a80b-0b206dd52177 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:42.136638 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b77be3ab-9019-42fd-a80b-0b206dd52177 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:42.137502 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b77be3ab-9019-42fd-a80b-0b206dd52177 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:42.139269 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b77be3ab-9019-42fd-a80b-0b206dd52177 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:42.140362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b77be3ab-9019-42fd-a80b-0b206dd52177 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:42.141258 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b77be3ab-9019-42fd-a80b-0b206dd52177 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:42.179214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b77be3ab-9019-42fd-a80b-0b206dd52177 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059232 Aug 08 14:37:42.183554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 545/1051] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:42 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:42.196214 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-31e6bbfb-bc5e-47af-b9c1-3075c813d6bf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:42.197846 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5e8b536a-0de3-4650-a71b-681489471d08 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:42.199379 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5e8b536a-0de3-4650-a71b-681489471d08 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:42.209312 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e8b536a-0de3-4650-a71b-681489471d08 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:42.210042 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e8b536a-0de3-4650-a71b-681489471d08 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:42.211016 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e8b536a-0de3-4650-a71b-681489471d08 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:42.214923 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e8b536a-0de3-4650-a71b-681489471d08 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:42.215556 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e8b536a-0de3-4650-a71b-681489471d08 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:42.216099 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e8b536a-0de3-4650-a71b-681489471d08 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:42.226296 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-31e6bbfb-bc5e-47af-b9c1-3075c813d6bf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:42.228497 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-31e6bbfb-bc5e-47af-b9c1-3075c813d6bf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:42.230016 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-31e6bbfb-bc5e-47af-b9c1-3075c813d6bf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1674 microversion: 2.20 time: 0.388131 Aug 08 14:37:42.232375 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 507/1052] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:41 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1674 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:42.266847 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5e8b536a-0de3-4650-a71b-681489471d08 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments/f0c52b0c-9e3a-4752-8f0b-d71603aa7149" status: 200 len: 194 microversion: 2.1 time: 0.075713 Aug 08 14:37:42.268208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 546/1053] 10.222.0.50 () {58 vars in 1413 bytes} [Mon Aug 8 14:37:42 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments/f0c52b0c-9e3a-4752-8f0b-d71603aa7149 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:42.428508 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8f92c102-55a3-4797-9938-52788c3c6403 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1608951979"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:42.429051 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8f92c102-55a3-4797-9938-52788c3c6403 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:42.440417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8f92c102-55a3-4797-9938-52788c3c6403 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:42.440417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8f92c102-55a3-4797-9938-52788c3c6403 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:42.440417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8f92c102-55a3-4797-9938-52788c3c6403 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:42.440417 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8f92c102-55a3-4797-9938-52788c3c6403 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:42.441320 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8f92c102-55a3-4797-9938-52788c3c6403 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:42.441320 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8f92c102-55a3-4797-9938-52788c3c6403 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:42.479815 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0d50e439-4034-4ffc-8a6a-90db08259720 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:42.481057 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-0d50e439-4034-4ffc-8a6a-90db08259720 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:42.493160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d50e439-4034-4ffc-8a6a-90db08259720 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:42.493669 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d50e439-4034-4ffc-8a6a-90db08259720 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:42.494174 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d50e439-4034-4ffc-8a6a-90db08259720 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:42.497908 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d50e439-4034-4ffc-8a6a-90db08259720 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:42.498573 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d50e439-4034-4ffc-8a6a-90db08259720 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:42.500878 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0d50e439-4034-4ffc-8a6a-90db08259720 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:42.946639 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-0d50e439-4034-4ffc-8a6a-90db08259720 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:42.955036 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.network.security_group_api [None req-8f92c102-55a3-4797-9938-52788c3c6403 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Removing security group 7623e397-3df8-49c5-88c7-50881c1d16b2 from port d8539c0a-5ff5-4ee6-883f-9961bff24df3 Aug 08 14:37:42.961651 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0d50e439-4034-4ffc-8a6a-90db08259720 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.491324 Aug 08 14:37:42.962725 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 547/1054] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:42 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:42.968045 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-fbd35b77-bcf6-4493-b109-05793dc29e3f req-671a312f-ff05-42be-8e35-9bfaa449100d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d8f2558-dee3-46cc-84ef-d11a1133d072", "name": "network-vif-plugged", "status": "completed", "tag": "935343b7-c1e4-41fe-8066-0a6e99a7578d"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:42.978994 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-fbd35b77-bcf6-4493-b109-05793dc29e3f req-671a312f-ff05-42be-8e35-9bfaa449100d service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:42.980127 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-fbd35b77-bcf6-4493-b109-05793dc29e3f req-671a312f-ff05-42be-8e35-9bfaa449100d service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:42.980570 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-fbd35b77-bcf6-4493-b109-05793dc29e3f req-671a312f-ff05-42be-8e35-9bfaa449100d service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:42.994434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-fbd35b77-bcf6-4493-b109-05793dc29e3f req-671a312f-ff05-42be-8e35-9bfaa449100d service nova] Creating event network-vif-plugged:935343b7-c1e4-41fe-8066-0a6e99a7578d for instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 on hv-cinder-85200 Aug 08 14:37:43.000128 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-fbd35b77-bcf6-4493-b109-05793dc29e3f req-671a312f-ff05-42be-8e35-9bfaa449100d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036069 Aug 08 14:37:43.001292 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 548/1055] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:43.128395 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-afe15235-dbb1-4eda-8fa5-9a47972a2b72 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:43.130740 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-afe15235-dbb1-4eda-8fa5-9a47972a2b72 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:43.137723 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-afe15235-dbb1-4eda-8fa5-9a47972a2b72 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:43.138298 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-afe15235-dbb1-4eda-8fa5-9a47972a2b72 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:43.139036 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-afe15235-dbb1-4eda-8fa5-9a47972a2b72 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:43.140340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-afe15235-dbb1-4eda-8fa5-9a47972a2b72 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:43.140872 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-afe15235-dbb1-4eda-8fa5-9a47972a2b72 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:43.141557 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-afe15235-dbb1-4eda-8fa5-9a47972a2b72 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:43.709346 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-afe15235-dbb1-4eda-8fa5-9a47972a2b72 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:43.718613 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-afe15235-dbb1-4eda-8fa5-9a47972a2b72 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1367 microversion: 2.1 time: 0.597047 Aug 08 14:37:43.720094 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 549/1056] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:43 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1367 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:43.725593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b67c7f7f-ec56-46f1-b674-0138e7e5b900 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:43.726423 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b67c7f7f-ec56-46f1-b674-0138e7e5b900 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:43.732813 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b67c7f7f-ec56-46f1-b674-0138e7e5b900 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:43.733564 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b67c7f7f-ec56-46f1-b674-0138e7e5b900 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:43.734205 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b67c7f7f-ec56-46f1-b674-0138e7e5b900 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:43.735485 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b67c7f7f-ec56-46f1-b674-0138e7e5b900 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:43.736129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b67c7f7f-ec56-46f1-b674-0138e7e5b900 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:43.736846 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b67c7f7f-ec56-46f1-b674-0138e7e5b900 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:43.877623 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8f92c102-55a3-4797-9938-52788c3c6403 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "POST /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/action" status: 202 len: 0 microversion: 2.1 time: 1.452336 Aug 08 14:37:43.877623 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 508/1057] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 14:37:42 2022] POST /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/action => generated 0 bytes in 1454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:37:43.889897 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c22ed3fd-500d-4c0c-b6a0-83c9460d9d92 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c6ec0c1-642d-4d37-98c1-78df3007a970"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:43.894086 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c22ed3fd-500d-4c0c-b6a0-83c9460d9d92 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:43.908128 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c22ed3fd-500d-4c0c-b6a0-83c9460d9d92 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:43.908624 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c22ed3fd-500d-4c0c-b6a0-83c9460d9d92 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:43.909063 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c22ed3fd-500d-4c0c-b6a0-83c9460d9d92 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:43.909773 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c22ed3fd-500d-4c0c-b6a0-83c9460d9d92 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:43.910226 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c22ed3fd-500d-4c0c-b6a0-83c9460d9d92 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:43.910648 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c22ed3fd-500d-4c0c-b6a0-83c9460d9d92 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:43.983687 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b67c7f7f-ec56-46f1-b674-0138e7e5b900 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:43.992405 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b67c7f7f-ec56-46f1-b674-0138e7e5b900 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:43.993955 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b67c7f7f-ec56-46f1-b674-0138e7e5b900 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:43.995161 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b67c7f7f-ec56-46f1-b674-0138e7e5b900 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.273833 Aug 08 14:37:43.995723 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 550/1058] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:43 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:44.000727 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-2f5c99a7-22b4-49d7-826b-514562855da7 req-a234e500-0cfc-471c-9cd8-5749b0072ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7117df5-9606-4392-a933-e624f6e97e2e", "tag": "d8539c0a-5ff5-4ee6-883f-9961bff24df3"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:44.010493 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-2f5c99a7-22b4-49d7-826b-514562855da7 req-a234e500-0cfc-471c-9cd8-5749b0072ef1 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:44.011297 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-2f5c99a7-22b4-49d7-826b-514562855da7 req-a234e500-0cfc-471c-9cd8-5749b0072ef1 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:44.011879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-2f5c99a7-22b4-49d7-826b-514562855da7 req-a234e500-0cfc-471c-9cd8-5749b0072ef1 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:44.024410 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-2f5c99a7-22b4-49d7-826b-514562855da7 req-a234e500-0cfc-471c-9cd8-5749b0072ef1 service nova] Creating event network-changed:d8539c0a-5ff5-4ee6-883f-9961bff24df3 for instance a7117df5-9606-4392-a933-e624f6e97e2e on hv-cinder-85200 Aug 08 14:37:44.029745 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-2f5c99a7-22b4-49d7-826b-514562855da7 req-a234e500-0cfc-471c-9cd8-5749b0072ef1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032647 Aug 08 14:37:44.030367 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 551/1059] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:44.040225 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-51d96921-a645-4a07-a3e7-90639ff3ba79 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:44.041178 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-51d96921-a645-4a07-a3e7-90639ff3ba79 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:44.049070 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-51d96921-a645-4a07-a3e7-90639ff3ba79 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:44.050101 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-51d96921-a645-4a07-a3e7-90639ff3ba79 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:44.050927 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-51d96921-a645-4a07-a3e7-90639ff3ba79 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:44.051864 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-51d96921-a645-4a07-a3e7-90639ff3ba79 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:44.052701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-51d96921-a645-4a07-a3e7-90639ff3ba79 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:44.053287 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-51d96921-a645-4a07-a3e7-90639ff3ba79 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:44.347378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-51d96921-a645-4a07-a3e7-90639ff3ba79 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:44.361681 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-51d96921-a645-4a07-a3e7-90639ff3ba79 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.325891 Aug 08 14:37:44.375812 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 552/1060] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:44 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:44.452785 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c22ed3fd-500d-4c0c-b6a0-83c9460d9d92 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "POST /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.575243 Aug 08 14:37:44.453743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 509/1061] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 14:37:43 2022] POST /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments => generated 194 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:44.511944 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c696cbaa-5ca2-4801-829e-7de8e9f4389f tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Action: 'create', calling method: .version_select at 0x7f9cb2435af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1206793014", "metadata": {"Type": "work"}}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c696cbaa-5ca2-4801-829e-7de8e9f4389f tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Request method failure captured: Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 122 Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R-49wRAAu6TOdr6af4pJXLzJFIY-uu-404peR0z6ujdHSAziI-5rd8z4_ExIc65i-M58-95OrM1LHMHng6wwMD-F7Yor2PVWcR_JlEcSQNmeZtQpeDWMwrd2BsMOf71GK5RL3A2yO_rB9U8fhQSuLAo7A8SSuDV4d66GwKwNGaNwx0 Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 99021fae40d44fe193cd522e77fc00be Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:37:44.531961 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:37:44.533554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/99021fae40d44fe193cd522e77fc00be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_99021fae40d44fe193cd522e77fc00be", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99021fae40d44fe193cd522e77fc00be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99021fae40d44fe193cd522e77fc00be"}]}] Aug 08 14:37:44.533554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.533554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 99021fae40d44fe193cd522e77fc00be Aug 08 14:37:44.533554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.533554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-VolumesNegativeTest-748209953-project Aug 08 14:37:44.533554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:37:44.533554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:37:44.533554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 494a65a27c774abba289f6d126087ff2 Aug 08 14:37:44.533554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-VolumesNegativeTest-748209953-project Aug 08 14:37:44.533554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Aug 08 14:37:44.533554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1206793014", "metadata": {"Type": "work"}}} Aug 08 14:37:44.533554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: Aug 08 14:37:44.533554 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1206793014', 'metadata': {'Type': 'work'}}}} Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise error Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi '#$%' Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:37:44.534517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 14:37:44.535990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 14:37:44.537463 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 14:37:44.537463 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.537463 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c696cbaa-5ca2-4801-829e-7de8e9f4389f tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:37:44.537463 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c696cbaa-5ca2-4801-829e-7de8e9f4389f tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.164498 Aug 08 14:37:44.537463 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 553/1062] 10.222.0.50 () {60 vars in 1156 bytes} [Mon Aug 8 14:37:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 14:37:44.545419 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bb8cabad-5ec1-4fcd-bd2c-5fa83e23bebd tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Action: 'create', calling method: .version_select at 0x7f9cb254aca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1807173671", "metadata": {"Type": "work"}}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bb8cabad-5ec1-4fcd-bd2c-5fa83e23bebd tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Request method failure captured: Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 120 Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R-49wRAAu6TOdr6af4pJXLzJFIY-uu-404peR0z6ujdHSAziI-5rd8z4_ExIc65i-M58-95OrM1LHMHng6wwMD-F7Yor2PVWcR_JlEcSQNmeZtQpeDWMwrd2BsMOf71GK5RL3A2yO_rB9U8fhQSuLAo7A8SSuDV4d66GwKwNGaNwx0 Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 99021fae40d44fe193cd522e77fc00be Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:37:44.550148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:37:44.551674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/99021fae40d44fe193cd522e77fc00be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_99021fae40d44fe193cd522e77fc00be", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99021fae40d44fe193cd522e77fc00be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99021fae40d44fe193cd522e77fc00be"}]}] Aug 08 14:37:44.551674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.551674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 99021fae40d44fe193cd522e77fc00be Aug 08 14:37:44.551674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.551674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesNegativeTest-748209953-project Aug 08 14:37:44.551674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:37:44.551674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:37:44.551674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 494a65a27c774abba289f6d126087ff2 Aug 08 14:37:44.551674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesNegativeTest-748209953-project Aug 08 14:37:44.551674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Aug 08 14:37:44.551674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1807173671", "metadata": {"Type": "work"}}} Aug 08 14:37:44.551674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: Aug 08 14:37:44.551674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1807173671', 'metadata': {'Type': 'work'}}}} Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise error Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi '0' Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:37:44.553066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 14:37:44.554342 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 14:37:44.555469 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 14:37:44.555469 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.555469 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bb8cabad-5ec1-4fcd-bd2c-5fa83e23bebd tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:37:44.555469 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bb8cabad-5ec1-4fcd-bd2c-5fa83e23bebd tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010496 Aug 08 14:37:44.555469 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 510/1063] 10.222.0.50 () {60 vars in 1156 bytes} [Mon Aug 8 14:37:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 14:37:44.561817 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-112b11d7-23ea-4678-a9c0-29917bdb7648 tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Action: 'create', calling method: .version_select at 0x7f9cb25c4dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-937580043", "metadata": {"Type": "work"}}} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-112b11d7-23ea-4678-a9c0-29917bdb7648 tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Request method failure captured: Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 118 Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R-49wRAAu6TOdr6af4pJXLzJFIY-uu-404peR0z6ujdHSAziI-5rd8z4_ExIc65i-M58-95OrM1LHMHng6wwMD-F7Yor2PVWcR_JlEcSQNmeZtQpeDWMwrd2BsMOf71GK5RL3A2yO_rB9U8fhQSuLAo7A8SSuDV4d66GwKwNGaNwx0 Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 99021fae40d44fe193cd522e77fc00be Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:37:44.566323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:37:44.568440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/99021fae40d44fe193cd522e77fc00be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_99021fae40d44fe193cd522e77fc00be", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99021fae40d44fe193cd522e77fc00be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99021fae40d44fe193cd522e77fc00be"}]}] Aug 08 14:37:44.568440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.568440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 99021fae40d44fe193cd522e77fc00be Aug 08 14:37:44.568440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.568440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-VolumesNegativeTest-748209953-project Aug 08 14:37:44.568440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:37:44.568440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:37:44.568440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 494a65a27c774abba289f6d126087ff2 Aug 08 14:37:44.568440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-VolumesNegativeTest-748209953-project Aug 08 14:37:44.568440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Aug 08 14:37:44.568440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-937580043", "metadata": {"Type": "work"}}} Aug 08 14:37:44.568440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: Aug 08 14:37:44.568440 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-937580043', 'metadata': {'Type': 'work'}}}} Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise error Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi '' Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:37:44.569318 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 14:37:44.570892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 14:37:44.572789 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 14:37:44.572789 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.572789 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-112b11d7-23ea-4678-a9c0-29917bdb7648 tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:37:44.572789 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-112b11d7-23ea-4678-a9c0-29917bdb7648 tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011150 Aug 08 14:37:44.572789 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 554/1064] 10.222.0.50 () {60 vars in 1156 bytes} [Mon Aug 8 14:37:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 14:37:44.582380 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-47687ea6-2af1-4c7d-ac13-5bca1a8d7faf tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Calling method '.version_select at 0x7f9cb2588c10>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:44.623827 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-47687ea6-2af1-4c7d-ac13-5bca1a8d7faf tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] HTTP exception thrown: Volume tempest-invalid-306424788 could not be found. Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-47687ea6-2af1-4c7d-ac13-5bca1a8d7faf tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Request method failure captured: Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-306424788 HTTP/1.1 Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R-49wRAAu6TOdr6af4pJXLzJFIY-uu-404peR0z6ujdHSAziI-5rd8z4_ExIc65i-M58-95OrM1LHMHng6wwMD-F7Yor2PVWcR_JlEcSQNmeZtQpeDWMwrd2BsMOf71GK5RL3A2yO_rB9U8fhQSuLAo7A8SSuDV4d66GwKwNGaNwx0 Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 99021fae40d44fe193cd522e77fc00be Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:37:44.625901 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:37:44.627544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/99021fae40d44fe193cd522e77fc00be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_99021fae40d44fe193cd522e77fc00be", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99021fae40d44fe193cd522e77fc00be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99021fae40d44fe193cd522e77fc00be"}]}] Aug 08 14:37:44.627544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.627544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 99021fae40d44fe193cd522e77fc00be Aug 08 14:37:44.627544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.627544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesNegativeTest-748209953-project Aug 08 14:37:44.627544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:37:44.627544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:37:44.627544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 494a65a27c774abba289f6d126087ff2 Aug 08 14:37:44.627544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesNegativeTest-748209953-project Aug 08 14:37:44.627544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: Aug 08 14:37:44.627544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Volume tempest-invalid-306424788 could not be found. Aug 08 14:37:44.627544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'tempest-invalid-306424788'} Aug 08 14:37:44.627544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-306424788 could not be found. (HTTP 404) (Request-ID: req-35f57272-9bdb-4686-823d-dbd77680e29a) Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.628502 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 14:37:44.629900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-306424788 could not be found. Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:37:44.631989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-306424788 could not be found. Aug 08 14:37:44.633393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.633393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.633393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.633393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.633393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:44.633393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:44.633393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:37:44.633393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:37:44.633393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-306424788 could not be found. Aug 08 14:37:44.633393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.633393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-47687ea6-2af1-4c7d-ac13-5bca1a8d7faf tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Returning 404 to user: Volume tempest-invalid-306424788 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:37:44.633393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-47687ea6-2af1-4c7d-ac13-5bca1a8d7faf tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-306424788" status: 404 len: 98 microversion: 2.1 time: 0.055444 Aug 08 14:37:44.635125 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 511/1065] 10.222.0.50 () {58 vars in 1215 bytes} [Mon Aug 8 14:37:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-306424788 => generated 98 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 08 14:37:44.644216 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7c7eed35-6edc-489b-8926-4d1afbb32300 tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004164 Aug 08 14:37:44.644859 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 555/1066] 10.222.0.50 () {58 vars in 1140 bytes} [Mon Aug 8 14:37:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 08 14:37:44.655789 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8c00c775-7c86-4ef8-b5ca-f4db341440fa tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004608 Aug 08 14:37:44.656566 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 512/1067] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Aug 8 14:37:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 08 14:37:44.665606 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-dbc504ce-3eb2-4d5a-894f-762e01b39bc0 tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Calling method '.version_select at 0x7f9cb284a280>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:44.695968 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-dbc504ce-3eb2-4d5a-894f-762e01b39bc0 tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] HTTP exception thrown: Volume 7bd8815d-cead-47ce-a009-97477e93917b could not be found. Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-dbc504ce-3eb2-4d5a-894f-762e01b39bc0 tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Request method failure captured: Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: DELETE /compute/v2.1/os-volumes/7bd8815d-cead-47ce-a009-97477e93917b HTTP/1.1 Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R-49wRAAu6TOdr6af4pJXLzJFIY-uu-404peR0z6ujdHSAziI-5rd8z4_ExIc65i-M58-95OrM1LHMHng6wwMD-F7Yor2PVWcR_JlEcSQNmeZtQpeDWMwrd2BsMOf71GK5RL3A2yO_rB9U8fhQSuLAo7A8SSuDV4d66GwKwNGaNwx0 Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 99021fae40d44fe193cd522e77fc00be Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:37:44.697939 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:37:44.699460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/99021fae40d44fe193cd522e77fc00be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_99021fae40d44fe193cd522e77fc00be", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99021fae40d44fe193cd522e77fc00be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99021fae40d44fe193cd522e77fc00be"}]}] Aug 08 14:37:44.699460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.699460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 99021fae40d44fe193cd522e77fc00be Aug 08 14:37:44.699460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.699460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-VolumesNegativeTest-748209953-project Aug 08 14:37:44.699460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:37:44.699460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:37:44.699460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 494a65a27c774abba289f6d126087ff2 Aug 08 14:37:44.699460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-VolumesNegativeTest-748209953-project Aug 08 14:37:44.699460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: Aug 08 14:37:44.699460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Volume 7bd8815d-cead-47ce-a009-97477e93917b could not be found. Aug 08 14:37:44.699460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': '7bd8815d-cead-47ce-a009-97477e93917b'} Aug 08 14:37:44.699460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7bd8815d-cead-47ce-a009-97477e93917b could not be found. (HTTP 404) (Request-ID: req-0428c0eb-0e61-4c0f-862d-ec23b364c5a5) Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.700228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 14:37:44.701326 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7bd8815d-cead-47ce-a009-97477e93917b could not be found. Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 14:37:44.702469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:37:44.703614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7bd8815d-cead-47ce-a009-97477e93917b could not be found. Aug 08 14:37:44.703614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.703614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.703614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.703614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.703614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:44.703614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:44.703614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:37:44.703614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:37:44.703614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7bd8815d-cead-47ce-a009-97477e93917b could not be found. Aug 08 14:37:44.703614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.703614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-dbc504ce-3eb2-4d5a-894f-762e01b39bc0 tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Returning 404 to user: Volume 7bd8815d-cead-47ce-a009-97477e93917b could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:37:44.703614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-dbc504ce-3eb2-4d5a-894f-762e01b39bc0 tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/7bd8815d-cead-47ce-a009-97477e93917b" status: 404 len: 109 microversion: 2.1 time: 0.038910 Aug 08 14:37:44.703614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 556/1068] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 14:37:44 2022] DELETE /compute/v2.1/os-volumes/7bd8815d-cead-47ce-a009-97477e93917b => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 14:37:44.714258 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-746d9ee5-a343-4b5d-b1a1-9b1a55feb5ee tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Calling method '.version_select at 0x7f9cb257c9d0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:44.742669 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f1f9b22c-9970-49ac-9d0d-582dc5dddc04 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:44.743319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f1f9b22c-9970-49ac-9d0d-582dc5dddc04 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:44.754055 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f1f9b22c-9970-49ac-9d0d-582dc5dddc04 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:44.754553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f1f9b22c-9970-49ac-9d0d-582dc5dddc04 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:44.755021 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f1f9b22c-9970-49ac-9d0d-582dc5dddc04 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:44.756278 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f1f9b22c-9970-49ac-9d0d-582dc5dddc04 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:44.757248 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f1f9b22c-9970-49ac-9d0d-582dc5dddc04 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:44.757699 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f1f9b22c-9970-49ac-9d0d-582dc5dddc04 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:44.761018 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-746d9ee5-a343-4b5d-b1a1-9b1a55feb5ee tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] HTTP exception thrown: Volume 4dcfdecc-4b6c-4321-80a1-d1cc1da7065d could not be found. Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-746d9ee5-a343-4b5d-b1a1-9b1a55feb5ee tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Request method failure captured: Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/os-volumes/4dcfdecc-4b6c-4321-80a1-d1cc1da7065d HTTP/1.1 Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R-49wRAAu6TOdr6af4pJXLzJFIY-uu-404peR0z6ujdHSAziI-5rd8z4_ExIc65i-M58-95OrM1LHMHng6wwMD-F7Yor2PVWcR_JlEcSQNmeZtQpeDWMwrd2BsMOf71GK5RL3A2yO_rB9U8fhQSuLAo7A8SSuDV4d66GwKwNGaNwx0 Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 99021fae40d44fe193cd522e77fc00be Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:37:44.763046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:37:44.764645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/99021fae40d44fe193cd522e77fc00be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_99021fae40d44fe193cd522e77fc00be", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99021fae40d44fe193cd522e77fc00be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99021fae40d44fe193cd522e77fc00be"}]}] Aug 08 14:37:44.764645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.764645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 99021fae40d44fe193cd522e77fc00be Aug 08 14:37:44.764645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesNegativeTest-748209953 Aug 08 14:37:44.764645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesNegativeTest-748209953-project Aug 08 14:37:44.764645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:37:44.764645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:37:44.764645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 494a65a27c774abba289f6d126087ff2 Aug 08 14:37:44.764645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesNegativeTest-748209953-project Aug 08 14:37:44.764645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: Aug 08 14:37:44.764645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Volume 4dcfdecc-4b6c-4321-80a1-d1cc1da7065d could not be found. Aug 08 14:37:44.764645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '4dcfdecc-4b6c-4321-80a1-d1cc1da7065d'} Aug 08 14:37:44.764645 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4dcfdecc-4b6c-4321-80a1-d1cc1da7065d could not be found. (HTTP 404) (Request-ID: req-a5c8bec4-17c4-4cdb-ae2d-6b462cae75ab) Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.765570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 14:37:44.768382 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4dcfdecc-4b6c-4321-80a1-d1cc1da7065d could not be found. Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 14:37:44.771227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:37:44.772611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4dcfdecc-4b6c-4321-80a1-d1cc1da7065d could not be found. Aug 08 14:37:44.772611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.772611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:44.772611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.772611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:44.772611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:44.772611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:44.772611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:37:44.772611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:37:44.772611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4dcfdecc-4b6c-4321-80a1-d1cc1da7065d could not be found. Aug 08 14:37:44.772611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:44.772611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-746d9ee5-a343-4b5d-b1a1-9b1a55feb5ee tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] Returning 404 to user: Volume 4dcfdecc-4b6c-4321-80a1-d1cc1da7065d could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:37:44.772611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-746d9ee5-a343-4b5d-b1a1-9b1a55feb5ee tempest-VolumesNegativeTest-748209953 tempest-VolumesNegativeTest-748209953-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4dcfdecc-4b6c-4321-80a1-d1cc1da7065d" status: 404 len: 109 microversion: 2.1 time: 0.058314 Aug 08 14:37:44.772611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 513/1069] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 14:37:44 2022] GET /compute/v2.1/os-volumes/4dcfdecc-4b6c-4321-80a1-d1cc1da7065d => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:37:45.022880 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-799b89fb-a4dc-4930-b894-1305cce94a8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:45.023999 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-799b89fb-a4dc-4930-b894-1305cce94a8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:45.039046 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-799b89fb-a4dc-4930-b894-1305cce94a8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:45.040152 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-799b89fb-a4dc-4930-b894-1305cce94a8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:45.040810 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-799b89fb-a4dc-4930-b894-1305cce94a8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:45.042071 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-799b89fb-a4dc-4930-b894-1305cce94a8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:45.044878 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-799b89fb-a4dc-4930-b894-1305cce94a8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:45.045624 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-799b89fb-a4dc-4930-b894-1305cce94a8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:45.066577 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f1f9b22c-9970-49ac-9d0d-582dc5dddc04 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:45.078269 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f1f9b22c-9970-49ac-9d0d-582dc5dddc04 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1367 microversion: 2.1 time: 0.340659 Aug 08 14:37:45.080891 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 557/1070] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:44 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1367 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:45.229668 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-799b89fb-a4dc-4930-b894-1305cce94a8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:45.238547 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-799b89fb-a4dc-4930-b894-1305cce94a8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:45.243104 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-799b89fb-a4dc-4930-b894-1305cce94a8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:45.245700 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-799b89fb-a4dc-4930-b894-1305cce94a8b tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.228812 Aug 08 14:37:45.247028 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 514/1071] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:45 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:45.351705 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-67df35f3-3ad2-4cf3-ba84-1d5a41fe3196 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:45.352529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-67df35f3-3ad2-4cf3-ba84-1d5a41fe3196 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:45.352695 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-6900deae-70c8-4797-8417-275cf56ede45 req-b67cf25a-7a5a-4a36-b4fb-d6d4a9ee97d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7117df5-9606-4392-a933-e624f6e97e2e", "tag": "d8539c0a-5ff5-4ee6-883f-9961bff24df3"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:45.359213 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67df35f3-3ad2-4cf3-ba84-1d5a41fe3196 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:45.360112 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67df35f3-3ad2-4cf3-ba84-1d5a41fe3196 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:45.361348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67df35f3-3ad2-4cf3-ba84-1d5a41fe3196 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:45.362294 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67df35f3-3ad2-4cf3-ba84-1d5a41fe3196 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:45.363251 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67df35f3-3ad2-4cf3-ba84-1d5a41fe3196 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:45.363897 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-67df35f3-3ad2-4cf3-ba84-1d5a41fe3196 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:45.373727 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-6900deae-70c8-4797-8417-275cf56ede45 req-b67cf25a-7a5a-4a36-b4fb-d6d4a9ee97d6 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:45.374219 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-6900deae-70c8-4797-8417-275cf56ede45 req-b67cf25a-7a5a-4a36-b4fb-d6d4a9ee97d6 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:45.374659 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-6900deae-70c8-4797-8417-275cf56ede45 req-b67cf25a-7a5a-4a36-b4fb-d6d4a9ee97d6 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:45.395398 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-6900deae-70c8-4797-8417-275cf56ede45 req-b67cf25a-7a5a-4a36-b4fb-d6d4a9ee97d6 service nova] Creating event network-changed:d8539c0a-5ff5-4ee6-883f-9961bff24df3 for instance a7117df5-9606-4392-a933-e624f6e97e2e on hv-cinder-85200 Aug 08 14:37:45.402124 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-6900deae-70c8-4797-8417-275cf56ede45 req-b67cf25a-7a5a-4a36-b4fb-d6d4a9ee97d6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054926 Aug 08 14:37:45.403453 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 515/1072] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:45.410450 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5ecb6707-fb5a-4789-b732-f444c3286e84 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:45.412010 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5ecb6707-fb5a-4789-b732-f444c3286e84 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:45.427473 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ecb6707-fb5a-4789-b732-f444c3286e84 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:45.428249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ecb6707-fb5a-4789-b732-f444c3286e84 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:45.428931 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ecb6707-fb5a-4789-b732-f444c3286e84 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:45.429894 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ecb6707-fb5a-4789-b732-f444c3286e84 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:45.430922 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ecb6707-fb5a-4789-b732-f444c3286e84 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:45.431621 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ecb6707-fb5a-4789-b732-f444c3286e84 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:45.576806 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-67df35f3-3ad2-4cf3-ba84-1d5a41fe3196 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lazy-loading 'services' on Instance uuid a7117df5-9606-4392-a933-e624f6e97e2e {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:37:45.789449 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-67df35f3-3ad2-4cf3-ba84-1d5a41fe3196 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments/1a96c406-ac1f-4e73-a218-3deec53252fe" status: 202 len: 0 microversion: 2.1 time: 0.445783 Aug 08 14:37:45.794908 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 558/1073] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 14:37:45 2022] DELETE /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments/1a96c406-ac1f-4e73-a218-3deec53252fe => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:37:45.806443 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-dfad6dd4-c85e-4623-ba79-c3075d1cc1f1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:45.824257 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-dfad6dd4-c85e-4623-ba79-c3075d1cc1f1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:45.845681 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dfad6dd4-c85e-4623-ba79-c3075d1cc1f1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:45.848471 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dfad6dd4-c85e-4623-ba79-c3075d1cc1f1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:45.865799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dfad6dd4-c85e-4623-ba79-c3075d1cc1f1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:45.867495 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dfad6dd4-c85e-4623-ba79-c3075d1cc1f1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:45.871048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dfad6dd4-c85e-4623-ba79-c3075d1cc1f1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:45.871770 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-dfad6dd4-c85e-4623-ba79-c3075d1cc1f1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:45.904544 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5ecb6707-fb5a-4789-b732-f444c3286e84 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:45.914134 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5ecb6707-fb5a-4789-b732-f444c3286e84 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.508837 Aug 08 14:37:45.926534 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 516/1074] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:45 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:45.952249 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-dfad6dd4-c85e-4623-ba79-c3075d1cc1f1 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155765 Aug 08 14:37:45.952972 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 559/1075] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:45 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:46.101237 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-06088e59-2473-4be5-b33c-9c15add26d50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:46.101863 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-06088e59-2473-4be5-b33c-9c15add26d50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:46.115733 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06088e59-2473-4be5-b33c-9c15add26d50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:46.116880 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06088e59-2473-4be5-b33c-9c15add26d50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:46.117540 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06088e59-2473-4be5-b33c-9c15add26d50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:46.118685 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06088e59-2473-4be5-b33c-9c15add26d50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:46.119621 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06088e59-2473-4be5-b33c-9c15add26d50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:46.121611 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06088e59-2473-4be5-b33c-9c15add26d50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:46.269458 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b7cea524-2584-41a4-9f84-418cc0782563 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:46.271945 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b7cea524-2584-41a4-9f84-418cc0782563 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:46.282297 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b7cea524-2584-41a4-9f84-418cc0782563 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:46.283612 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b7cea524-2584-41a4-9f84-418cc0782563 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:46.284428 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b7cea524-2584-41a4-9f84-418cc0782563 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:46.285711 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b7cea524-2584-41a4-9f84-418cc0782563 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:46.286983 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b7cea524-2584-41a4-9f84-418cc0782563 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:46.287654 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b7cea524-2584-41a4-9f84-418cc0782563 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:46.674207 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-06088e59-2473-4be5-b33c-9c15add26d50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:46.683976 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-06088e59-2473-4be5-b33c-9c15add26d50 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1557 microversion: 2.1 time: 0.586744 Aug 08 14:37:46.707330 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 517/1076] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:46 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1557 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:46.721116 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-95638e81-cbc2-48c7-83ce-bd8a54d42d48 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:46.721664 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-95638e81-cbc2-48c7-83ce-bd8a54d42d48 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:46.745410 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95638e81-cbc2-48c7-83ce-bd8a54d42d48 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:46.745909 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95638e81-cbc2-48c7-83ce-bd8a54d42d48 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:46.746350 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95638e81-cbc2-48c7-83ce-bd8a54d42d48 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:46.747070 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95638e81-cbc2-48c7-83ce-bd8a54d42d48 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:46.749048 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95638e81-cbc2-48c7-83ce-bd8a54d42d48 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:46.749497 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95638e81-cbc2-48c7-83ce-bd8a54d42d48 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:46.845280 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b7cea524-2584-41a4-9f84-418cc0782563 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:46.862416 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b7cea524-2584-41a4-9f84-418cc0782563 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:46.868984 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b7cea524-2584-41a4-9f84-418cc0782563 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:46.870467 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b7cea524-2584-41a4-9f84-418cc0782563 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.605639 Aug 08 14:37:46.871441 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 560/1077] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:46 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:46.936558 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-549a1dba-4df8-4567-ba5a-5622babb6aad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:46.937462 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-549a1dba-4df8-4567-ba5a-5622babb6aad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:46.945389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-549a1dba-4df8-4567-ba5a-5622babb6aad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:46.946493 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-549a1dba-4df8-4567-ba5a-5622babb6aad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:46.947263 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-549a1dba-4df8-4567-ba5a-5622babb6aad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:46.949012 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-549a1dba-4df8-4567-ba5a-5622babb6aad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:46.949938 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-549a1dba-4df8-4567-ba5a-5622babb6aad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:46.950373 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-549a1dba-4df8-4567-ba5a-5622babb6aad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:47.143061 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-95638e81-cbc2-48c7-83ce-bd8a54d42d48 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.432751 Aug 08 14:37:47.153574 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 518/1078] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 14:37:46 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072/os-interface => generated 285 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:47.158947 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a0ff420c-746a-4da9-a1ef-2bb6125951b3 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:47.170591 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a0ff420c-746a-4da9-a1ef-2bb6125951b3 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:47.185029 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0ff420c-746a-4da9-a1ef-2bb6125951b3 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:47.187542 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0ff420c-746a-4da9-a1ef-2bb6125951b3 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:47.188835 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0ff420c-746a-4da9-a1ef-2bb6125951b3 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:47.190066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0ff420c-746a-4da9-a1ef-2bb6125951b3 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:47.190474 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0ff420c-746a-4da9-a1ef-2bb6125951b3 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:47.191120 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0ff420c-746a-4da9-a1ef-2bb6125951b3 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:47.258402 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a0ff420c-746a-4da9-a1ef-2bb6125951b3 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103395 Aug 08 14:37:47.266102 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 519/1079] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:47 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:47.282993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-549a1dba-4df8-4567-ba5a-5622babb6aad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:47.303175 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-549a1dba-4df8-4567-ba5a-5622babb6aad tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.371758 Aug 08 14:37:47.304205 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 561/1080] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:46 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:47.894730 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-349d7c4b-6f39-4567-9019-9f4c8bcd7b79 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:47.896246 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-349d7c4b-6f39-4567-9019-9f4c8bcd7b79 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:47.908644 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-349d7c4b-6f39-4567-9019-9f4c8bcd7b79 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:47.910416 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-349d7c4b-6f39-4567-9019-9f4c8bcd7b79 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:47.913008 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-349d7c4b-6f39-4567-9019-9f4c8bcd7b79 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:47.917969 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-349d7c4b-6f39-4567-9019-9f4c8bcd7b79 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:47.920673 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-349d7c4b-6f39-4567-9019-9f4c8bcd7b79 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:47.921442 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-349d7c4b-6f39-4567-9019-9f4c8bcd7b79 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:48.254684 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-349d7c4b-6f39-4567-9019-9f4c8bcd7b79 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:48.272709 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b5cb3ca3-830e-40f2-9b20-0ce74e847745 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:48.275229 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b5cb3ca3-830e-40f2-9b20-0ce74e847745 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:48.282725 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-349d7c4b-6f39-4567-9019-9f4c8bcd7b79 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:48.286241 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-349d7c4b-6f39-4567-9019-9f4c8bcd7b79 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:48.290310 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b5cb3ca3-830e-40f2-9b20-0ce74e847745 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:48.292230 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-349d7c4b-6f39-4567-9019-9f4c8bcd7b79 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.401813 Aug 08 14:37:48.293789 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b5cb3ca3-830e-40f2-9b20-0ce74e847745 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:48.295055 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b5cb3ca3-830e-40f2-9b20-0ce74e847745 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:48.295239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 520/1081] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:47 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:48.296131 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b5cb3ca3-830e-40f2-9b20-0ce74e847745 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:48.296747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b5cb3ca3-830e-40f2-9b20-0ce74e847745 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:48.297337 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b5cb3ca3-830e-40f2-9b20-0ce74e847745 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:48.325571 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e9e110cd-3c79-41f3-b3ef-8a162b3f953a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:48.326826 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e9e110cd-3c79-41f3-b3ef-8a162b3f953a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:48.336938 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e9e110cd-3c79-41f3-b3ef-8a162b3f953a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:48.342862 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e9e110cd-3c79-41f3-b3ef-8a162b3f953a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:48.343572 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e9e110cd-3c79-41f3-b3ef-8a162b3f953a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:48.344722 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e9e110cd-3c79-41f3-b3ef-8a162b3f953a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:48.345330 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e9e110cd-3c79-41f3-b3ef-8a162b3f953a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:48.345906 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e9e110cd-3c79-41f3-b3ef-8a162b3f953a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:48.365889 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b5cb3ca3-830e-40f2-9b20-0ce74e847745 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098821 Aug 08 14:37:48.369460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 562/1082] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:48 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:37:48.542044 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e9e110cd-3c79-41f3-b3ef-8a162b3f953a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:48.552199 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e9e110cd-3c79-41f3-b3ef-8a162b3f953a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.229834 Aug 08 14:37:48.555242 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 521/1083] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:48 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:48.887385 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-b64f4c0b-1359-45ce-a610-446229c0aad1 req-a24cb871-c006-4a95-8b3a-c0e2c9da972f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d8f2558-dee3-46cc-84ef-d11a1133d072", "tag": "935343b7-c1e4-41fe-8066-0a6e99a7578d"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:48.907492 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-b64f4c0b-1359-45ce-a610-446229c0aad1 req-a24cb871-c006-4a95-8b3a-c0e2c9da972f service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:48.909119 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-b64f4c0b-1359-45ce-a610-446229c0aad1 req-a24cb871-c006-4a95-8b3a-c0e2c9da972f service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:48.909791 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-b64f4c0b-1359-45ce-a610-446229c0aad1 req-a24cb871-c006-4a95-8b3a-c0e2c9da972f service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:48.937416 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-b64f4c0b-1359-45ce-a610-446229c0aad1 req-a24cb871-c006-4a95-8b3a-c0e2c9da972f service nova] Creating event network-changed:935343b7-c1e4-41fe-8066-0a6e99a7578d for instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 on hv-cinder-85200 Aug 08 14:37:48.953348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-b64f4c0b-1359-45ce-a610-446229c0aad1 req-a24cb871-c006-4a95-8b3a-c0e2c9da972f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073825 Aug 08 14:37:48.955148 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 563/1084] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:49.321259 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2a556ce8-7885-4f59-b975-41cae14b8a28 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:49.323325 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2a556ce8-7885-4f59-b975-41cae14b8a28 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:49.339295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a556ce8-7885-4f59-b975-41cae14b8a28 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:49.341076 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a556ce8-7885-4f59-b975-41cae14b8a28 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:49.342572 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a556ce8-7885-4f59-b975-41cae14b8a28 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:49.357487 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a556ce8-7885-4f59-b975-41cae14b8a28 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:49.358246 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a556ce8-7885-4f59-b975-41cae14b8a28 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:49.360909 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2a556ce8-7885-4f59-b975-41cae14b8a28 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:49.382991 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-e76c8da8-b84a-4dca-b3aa-352323c2d355 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:49.386052 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-e76c8da8-b84a-4dca-b3aa-352323c2d355 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:49.398257 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e76c8da8-b84a-4dca-b3aa-352323c2d355 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:49.398931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e76c8da8-b84a-4dca-b3aa-352323c2d355 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:49.399564 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e76c8da8-b84a-4dca-b3aa-352323c2d355 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:49.400463 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e76c8da8-b84a-4dca-b3aa-352323c2d355 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:49.401346 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e76c8da8-b84a-4dca-b3aa-352323c2d355 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:49.401970 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-e76c8da8-b84a-4dca-b3aa-352323c2d355 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:49.406890 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:49.456518 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-e76c8da8-b84a-4dca-b3aa-352323c2d355 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079403 Aug 08 14:37:49.465105 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 564/1085] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:49 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:37:49.575431 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ce090d9c-cda0-4136-8d6a-e841d12cc559 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:49.576325 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ce090d9c-cda0-4136-8d6a-e841d12cc559 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:49.592267 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce090d9c-cda0-4136-8d6a-e841d12cc559 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:49.593233 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce090d9c-cda0-4136-8d6a-e841d12cc559 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:49.596106 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce090d9c-cda0-4136-8d6a-e841d12cc559 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:49.599678 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce090d9c-cda0-4136-8d6a-e841d12cc559 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:49.600174 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce090d9c-cda0-4136-8d6a-e841d12cc559 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:49.600648 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce090d9c-cda0-4136-8d6a-e841d12cc559 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:49.924470 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2a556ce8-7885-4f59-b975-41cae14b8a28 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:49.941065 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2a556ce8-7885-4f59-b975-41cae14b8a28 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:49.943338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2a556ce8-7885-4f59-b975-41cae14b8a28 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:49.944759 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2a556ce8-7885-4f59-b975-41cae14b8a28 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.628715 Aug 08 14:37:49.955896 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 522/1086] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:49 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:50.065890 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ce090d9c-cda0-4136-8d6a-e841d12cc559 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:50.079879 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ce090d9c-cda0-4136-8d6a-e841d12cc559 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.508940 Aug 08 14:37:50.081555 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 565/1087] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:49 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:37:50.485228 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a0a0bcab-e4c8-499f-9b72-ea93f4e17913 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:50.488572 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a0a0bcab-e4c8-499f-9b72-ea93f4e17913 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:50.515998 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0a0bcab-e4c8-499f-9b72-ea93f4e17913 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:50.516915 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0a0bcab-e4c8-499f-9b72-ea93f4e17913 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:50.517675 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0a0bcab-e4c8-499f-9b72-ea93f4e17913 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:50.518589 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0a0bcab-e4c8-499f-9b72-ea93f4e17913 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:50.524403 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0a0bcab-e4c8-499f-9b72-ea93f4e17913 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:50.525093 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0a0bcab-e4c8-499f-9b72-ea93f4e17913 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:50.600350 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a0a0bcab-e4c8-499f-9b72-ea93f4e17913 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121513 Aug 08 14:37:50.605459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 523/1088] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:50 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:37:50.810475 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-fcb51763-6545-4131-83c6-bc8872aa9b93 req-8dbd6f7f-43a1-4980-939f-e1f7697ce42c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eff17af-e081-4582-82fb-ba2f7a45c338", "name": "network-vif-plugged", "status": "completed", "tag": "54289b72-3379-4dba-9ae7-835b040e581b"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:37:50.835468 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-fcb51763-6545-4131-83c6-bc8872aa9b93 req-8dbd6f7f-43a1-4980-939f-e1f7697ce42c service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:50.836307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-fcb51763-6545-4131-83c6-bc8872aa9b93 req-8dbd6f7f-43a1-4980-939f-e1f7697ce42c service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:50.837011 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-fcb51763-6545-4131-83c6-bc8872aa9b93 req-8dbd6f7f-43a1-4980-939f-e1f7697ce42c service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:50.861761 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-fcb51763-6545-4131-83c6-bc8872aa9b93 req-8dbd6f7f-43a1-4980-939f-e1f7697ce42c service nova] Creating event network-vif-plugged:54289b72-3379-4dba-9ae7-835b040e581b for instance 0eff17af-e081-4582-82fb-ba2f7a45c338 on hv-cinder-85200 Aug 08 14:37:50.871421 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-fcb51763-6545-4131-83c6-bc8872aa9b93 req-8dbd6f7f-43a1-4980-939f-e1f7697ce42c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064654 Aug 08 14:37:50.874242 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 566/1089] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:50.972546 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-59655dc4-1535-49ed-98a9-a542b1603808 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:50.973864 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-59655dc4-1535-49ed-98a9-a542b1603808 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:50.984215 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-59655dc4-1535-49ed-98a9-a542b1603808 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:50.987340 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-59655dc4-1535-49ed-98a9-a542b1603808 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:50.990557 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-59655dc4-1535-49ed-98a9-a542b1603808 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:50.991330 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-59655dc4-1535-49ed-98a9-a542b1603808 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:50.992504 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-59655dc4-1535-49ed-98a9-a542b1603808 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:50.993119 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-59655dc4-1535-49ed-98a9-a542b1603808 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:51.102818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-08a0cb5d-8291-4015-ad4c-4e0a48dc948e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:51.103866 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-08a0cb5d-8291-4015-ad4c-4e0a48dc948e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:51.116740 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-08a0cb5d-8291-4015-ad4c-4e0a48dc948e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:51.117502 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-08a0cb5d-8291-4015-ad4c-4e0a48dc948e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:51.118100 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-08a0cb5d-8291-4015-ad4c-4e0a48dc948e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:51.118982 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-08a0cb5d-8291-4015-ad4c-4e0a48dc948e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:51.119618 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-08a0cb5d-8291-4015-ad4c-4e0a48dc948e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:51.120257 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-08a0cb5d-8291-4015-ad4c-4e0a48dc948e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:51.463400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-08a0cb5d-8291-4015-ad4c-4e0a48dc948e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:51.480062 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-08a0cb5d-8291-4015-ad4c-4e0a48dc948e tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.381412 Aug 08 14:37:51.482409 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 567/1090] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:51 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:51.515453 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-59655dc4-1535-49ed-98a9-a542b1603808 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:51.525661 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-59655dc4-1535-49ed-98a9-a542b1603808 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:51.527592 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-59655dc4-1535-49ed-98a9-a542b1603808 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:51.529079 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-59655dc4-1535-49ed-98a9-a542b1603808 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.561121 Aug 08 14:37:51.543579 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 524/1091] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:50 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:51.612873 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5beda245-6b9e-4619-af1d-14313d46659e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:51.615704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5beda245-6b9e-4619-af1d-14313d46659e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:51.626191 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5beda245-6b9e-4619-af1d-14313d46659e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:51.628858 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5beda245-6b9e-4619-af1d-14313d46659e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:51.630613 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5beda245-6b9e-4619-af1d-14313d46659e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:51.633216 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5beda245-6b9e-4619-af1d-14313d46659e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:51.633865 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5beda245-6b9e-4619-af1d-14313d46659e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:51.634473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5beda245-6b9e-4619-af1d-14313d46659e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:51.700231 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5beda245-6b9e-4619-af1d-14313d46659e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091631 Aug 08 14:37:51.711883 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 568/1092] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:51 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:37:52.502319 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3288ff29-8095-445d-aa25-94a0428a881a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:52.503107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3288ff29-8095-445d-aa25-94a0428a881a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:52.511298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3288ff29-8095-445d-aa25-94a0428a881a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:52.512254 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3288ff29-8095-445d-aa25-94a0428a881a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:52.512969 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3288ff29-8095-445d-aa25-94a0428a881a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:52.514018 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3288ff29-8095-445d-aa25-94a0428a881a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:52.514837 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3288ff29-8095-445d-aa25-94a0428a881a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:52.515624 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3288ff29-8095-445d-aa25-94a0428a881a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:52.554606 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-4dfe7e53-d26d-48df-8521-d8826f4b45d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:52.555881 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-4dfe7e53-d26d-48df-8521-d8826f4b45d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:52.566529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:52.569677 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4dfe7e53-d26d-48df-8521-d8826f4b45d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:52.571492 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4dfe7e53-d26d-48df-8521-d8826f4b45d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:52.572230 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4dfe7e53-d26d-48df-8521-d8826f4b45d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:52.574925 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4dfe7e53-d26d-48df-8521-d8826f4b45d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:52.575672 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4dfe7e53-d26d-48df-8521-d8826f4b45d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:52.576429 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-4dfe7e53-d26d-48df-8521-d8826f4b45d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:52.818777 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3288ff29-8095-445d-aa25-94a0428a881a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:52.825050 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4dfe7e53-d26d-48df-8521-d8826f4b45d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:52.826538 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3288ff29-8095-445d-aa25-94a0428a881a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.328595 Aug 08 14:37:52.827444 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 525/1093] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:52 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:52.833692 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e99bf266-bab3-4847-b763-42133c25d70c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:52.836212 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e99bf266-bab3-4847-b763-42133c25d70c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:52.865496 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4dfe7e53-d26d-48df-8521-d8826f4b45d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:52.870917 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-4dfe7e53-d26d-48df-8521-d8826f4b45d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:52.872319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-4dfe7e53-d26d-48df-8521-d8826f4b45d3 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.321836 Aug 08 14:37:52.877599 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 569/1094] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:52 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:52.878422 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e99bf266-bab3-4847-b763-42133c25d70c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:52.878964 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e99bf266-bab3-4847-b763-42133c25d70c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:52.879432 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e99bf266-bab3-4847-b763-42133c25d70c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:52.882296 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e99bf266-bab3-4847-b763-42133c25d70c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:52.882949 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e99bf266-bab3-4847-b763-42133c25d70c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:52.889673 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e99bf266-bab3-4847-b763-42133c25d70c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:52.961686 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e99bf266-bab3-4847-b763-42133c25d70c tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127960 Aug 08 14:37:52.962622 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 526/1095] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:52 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:53.853373 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-58282da6-df9b-4aea-83f4-f662f43e2254 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:53.854076 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-58282da6-df9b-4aea-83f4-f662f43e2254 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:53.860718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-58282da6-df9b-4aea-83f4-f662f43e2254 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:53.861205 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-58282da6-df9b-4aea-83f4-f662f43e2254 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:53.861668 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-58282da6-df9b-4aea-83f4-f662f43e2254 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:53.862319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-58282da6-df9b-4aea-83f4-f662f43e2254 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:53.862773 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-58282da6-df9b-4aea-83f4-f662f43e2254 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:53.863233 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-58282da6-df9b-4aea-83f4-f662f43e2254 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:53.904516 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-60762fd7-dce8-4596-af64-f2669c4c35a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:53.905257 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-60762fd7-dce8-4596-af64-f2669c4c35a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:53.912315 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60762fd7-dce8-4596-af64-f2669c4c35a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:53.912807 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60762fd7-dce8-4596-af64-f2669c4c35a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:53.913244 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60762fd7-dce8-4596-af64-f2669c4c35a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:53.914047 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60762fd7-dce8-4596-af64-f2669c4c35a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:53.914511 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60762fd7-dce8-4596-af64-f2669c4c35a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:53.914927 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-60762fd7-dce8-4596-af64-f2669c4c35a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:54.122915 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-58282da6-df9b-4aea-83f4-f662f43e2254 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:54.137388 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-58282da6-df9b-4aea-83f4-f662f43e2254 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.288426 Aug 08 14:37:54.140566 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 570/1096] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:53 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:54.155320 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f28fca2f-18ef-45b8-900f-304cdcc694e7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:54.157481 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f28fca2f-18ef-45b8-900f-304cdcc694e7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:54.173943 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f28fca2f-18ef-45b8-900f-304cdcc694e7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:54.174796 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f28fca2f-18ef-45b8-900f-304cdcc694e7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:54.180234 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f28fca2f-18ef-45b8-900f-304cdcc694e7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:54.181238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f28fca2f-18ef-45b8-900f-304cdcc694e7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:54.183270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f28fca2f-18ef-45b8-900f-304cdcc694e7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:54.184642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f28fca2f-18ef-45b8-900f-304cdcc694e7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:54.198004 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-60762fd7-dce8-4596-af64-f2669c4c35a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:54.210368 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-60762fd7-dce8-4596-af64-f2669c4c35a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:54.212319 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-60762fd7-dce8-4596-af64-f2669c4c35a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:54.214330 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-60762fd7-dce8-4596-af64-f2669c4c35a6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.313832 Aug 08 14:37:54.215279 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 527/1097] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:53 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:54.259898 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f28fca2f-18ef-45b8-900f-304cdcc694e7 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118168 Aug 08 14:37:54.261049 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 571/1098] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:54 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:55.158885 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0d331465-dd25-4d3e-af7c-fc12244b9cac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:55.159551 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0d331465-dd25-4d3e-af7c-fc12244b9cac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:55.166797 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0d331465-dd25-4d3e-af7c-fc12244b9cac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:55.167299 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0d331465-dd25-4d3e-af7c-fc12244b9cac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:55.167746 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0d331465-dd25-4d3e-af7c-fc12244b9cac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:55.168622 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0d331465-dd25-4d3e-af7c-fc12244b9cac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:55.168883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0d331465-dd25-4d3e-af7c-fc12244b9cac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:55.169485 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0d331465-dd25-4d3e-af7c-fc12244b9cac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:55.174187 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:37:55.239338 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-fe2dc486-f6d3-4b56-ad17-43f662aaf22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:55.241388 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-fe2dc486-f6d3-4b56-ad17-43f662aaf22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:55.248489 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fe2dc486-f6d3-4b56-ad17-43f662aaf22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:55.249068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fe2dc486-f6d3-4b56-ad17-43f662aaf22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:55.249512 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fe2dc486-f6d3-4b56-ad17-43f662aaf22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:55.250502 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fe2dc486-f6d3-4b56-ad17-43f662aaf22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:55.250666 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fe2dc486-f6d3-4b56-ad17-43f662aaf22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:55.251108 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fe2dc486-f6d3-4b56-ad17-43f662aaf22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:55.405713 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0d331465-dd25-4d3e-af7c-fc12244b9cac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:55.415590 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0d331465-dd25-4d3e-af7c-fc12244b9cac tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.260702 Aug 08 14:37:55.416145 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 528/1099] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:55 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:55.421099 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0cd8bb09-fb9e-4c71-bc59-ca7846813e94 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:55.423285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0cd8bb09-fb9e-4c71-bc59-ca7846813e94 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:55.429370 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0cd8bb09-fb9e-4c71-bc59-ca7846813e94 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:55.430556 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0cd8bb09-fb9e-4c71-bc59-ca7846813e94 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:55.432176 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0cd8bb09-fb9e-4c71-bc59-ca7846813e94 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:55.436042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0cd8bb09-fb9e-4c71-bc59-ca7846813e94 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:55.436523 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0cd8bb09-fb9e-4c71-bc59-ca7846813e94 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:55.436964 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0cd8bb09-fb9e-4c71-bc59-ca7846813e94 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:55.470074 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0cd8bb09-fb9e-4c71-bc59-ca7846813e94 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052567 Aug 08 14:37:55.471125 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 529/1100] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:55 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:55.512846 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-fe2dc486-f6d3-4b56-ad17-43f662aaf22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:55.521531 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-fe2dc486-f6d3-4b56-ad17-43f662aaf22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:55.524033 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-fe2dc486-f6d3-4b56-ad17-43f662aaf22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:55.525384 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-fe2dc486-f6d3-4b56-ad17-43f662aaf22a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.290151 Aug 08 14:37:55.526456 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 572/1101] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:55 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:56.435945 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-96161559-85d9-4308-af97-c92827d96ee4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:56.436585 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-96161559-85d9-4308-af97-c92827d96ee4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:56.443174 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96161559-85d9-4308-af97-c92827d96ee4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:56.443664 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96161559-85d9-4308-af97-c92827d96ee4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:56.444092 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96161559-85d9-4308-af97-c92827d96ee4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:56.444794 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96161559-85d9-4308-af97-c92827d96ee4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:56.445242 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96161559-85d9-4308-af97-c92827d96ee4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:56.445660 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96161559-85d9-4308-af97-c92827d96ee4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:56.482220 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5d0c35cf-f841-4273-af8a-a83eb7b45394 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:56.484463 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5d0c35cf-f841-4273-af8a-a83eb7b45394 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:56.491679 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d0c35cf-f841-4273-af8a-a83eb7b45394 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:56.492454 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d0c35cf-f841-4273-af8a-a83eb7b45394 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:56.492895 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d0c35cf-f841-4273-af8a-a83eb7b45394 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:56.493595 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d0c35cf-f841-4273-af8a-a83eb7b45394 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:56.494214 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d0c35cf-f841-4273-af8a-a83eb7b45394 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:56.494805 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5d0c35cf-f841-4273-af8a-a83eb7b45394 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:56.525598 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5d0c35cf-f841-4273-af8a-a83eb7b45394 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047334 Aug 08 14:37:56.526610 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 573/1102] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:56 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:56.549106 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3683376a-3b52-47f9-a6b9-00d9c4f4560e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:56.549717 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3683376a-3b52-47f9-a6b9-00d9c4f4560e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:56.555841 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3683376a-3b52-47f9-a6b9-00d9c4f4560e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:56.556328 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3683376a-3b52-47f9-a6b9-00d9c4f4560e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:56.557171 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3683376a-3b52-47f9-a6b9-00d9c4f4560e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:56.557884 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3683376a-3b52-47f9-a6b9-00d9c4f4560e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:56.558287 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3683376a-3b52-47f9-a6b9-00d9c4f4560e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:56.559131 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3683376a-3b52-47f9-a6b9-00d9c4f4560e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:56.699285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-96161559-85d9-4308-af97-c92827d96ee4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:56.709723 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-96161559-85d9-4308-af97-c92827d96ee4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.277491 Aug 08 14:37:56.711637 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 530/1103] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:56 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:56.755376 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3683376a-3b52-47f9-a6b9-00d9c4f4560e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:56.763363 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3683376a-3b52-47f9-a6b9-00d9c4f4560e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:56.764953 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3683376a-3b52-47f9-a6b9-00d9c4f4560e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:56.766036 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3683376a-3b52-47f9-a6b9-00d9c4f4560e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.221408 Aug 08 14:37:56.766593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 574/1104] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:56 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:57.538283 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f7da7f08-622b-4247-bed3-f0269ce41464 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:57.540405 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f7da7f08-622b-4247-bed3-f0269ce41464 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:57.546796 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f7da7f08-622b-4247-bed3-f0269ce41464 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:57.547315 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f7da7f08-622b-4247-bed3-f0269ce41464 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:57.547756 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f7da7f08-622b-4247-bed3-f0269ce41464 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:57.551944 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f7da7f08-622b-4247-bed3-f0269ce41464 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:57.552451 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f7da7f08-622b-4247-bed3-f0269ce41464 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:57.552892 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f7da7f08-622b-4247-bed3-f0269ce41464 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:57.583318 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f7da7f08-622b-4247-bed3-f0269ce41464 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049422 Aug 08 14:37:57.583890 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 531/1105] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:57 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:57.735410 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-367e4e1c-8104-45a8-b3d2-48b7cc5613df tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:57.735410 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-367e4e1c-8104-45a8-b3d2-48b7cc5613df tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:57.744098 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-367e4e1c-8104-45a8-b3d2-48b7cc5613df tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:57.745120 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-367e4e1c-8104-45a8-b3d2-48b7cc5613df tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:57.745623 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-367e4e1c-8104-45a8-b3d2-48b7cc5613df tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:57.747355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-367e4e1c-8104-45a8-b3d2-48b7cc5613df tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:57.747836 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-367e4e1c-8104-45a8-b3d2-48b7cc5613df tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:57.748267 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-367e4e1c-8104-45a8-b3d2-48b7cc5613df tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:57.752603 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a496bb15-f9f5-47af-b648-1dd1318f0919 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:57.754747 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a496bb15-f9f5-47af-b648-1dd1318f0919 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:57.760593 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a496bb15-f9f5-47af-b648-1dd1318f0919 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:57.761269 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a496bb15-f9f5-47af-b648-1dd1318f0919 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:57.761700 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a496bb15-f9f5-47af-b648-1dd1318f0919 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:57.762575 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a496bb15-f9f5-47af-b648-1dd1318f0919 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:57.763030 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a496bb15-f9f5-47af-b648-1dd1318f0919 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:57.763483 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a496bb15-f9f5-47af-b648-1dd1318f0919 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:57.794236 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a496bb15-f9f5-47af-b648-1dd1318f0919 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045483 Aug 08 14:37:57.794814 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 532/1106] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:57 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:57.806460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a3a956a2-4713-4317-9a08-5ccdd4d71faf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:57.807067 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a3a956a2-4713-4317-9a08-5ccdd4d71faf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:57.813043 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a3a956a2-4713-4317-9a08-5ccdd4d71faf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:57.813526 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a3a956a2-4713-4317-9a08-5ccdd4d71faf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:57.813956 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a3a956a2-4713-4317-9a08-5ccdd4d71faf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:57.814666 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a3a956a2-4713-4317-9a08-5ccdd4d71faf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:57.815140 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a3a956a2-4713-4317-9a08-5ccdd4d71faf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:57.815570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a3a956a2-4713-4317-9a08-5ccdd4d71faf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:57.947421 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-367e4e1c-8104-45a8-b3d2-48b7cc5613df tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:57.955401 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-367e4e1c-8104-45a8-b3d2-48b7cc5613df tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1576 microversion: 2.1 time: 0.226651 Aug 08 14:37:57.956185 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 575/1107] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:57 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:57.961691 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-635d9e9c-12e0-45ed-9a82-805c72da034d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:57.962434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-635d9e9c-12e0-45ed-9a82-805c72da034d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:57.968478 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-635d9e9c-12e0-45ed-9a82-805c72da034d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:57.969208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-635d9e9c-12e0-45ed-9a82-805c72da034d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:57.969960 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-635d9e9c-12e0-45ed-9a82-805c72da034d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:57.970875 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-635d9e9c-12e0-45ed-9a82-805c72da034d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:57.971353 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-635d9e9c-12e0-45ed-9a82-805c72da034d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:57.971779 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-635d9e9c-12e0-45ed-9a82-805c72da034d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:57.993347 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a3a956a2-4713-4317-9a08-5ccdd4d71faf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:58.002130 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-635d9e9c-12e0-45ed-9a82-805c72da034d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments/f0c52b0c-9e3a-4752-8f0b-d71603aa7149" status: 200 len: 194 microversion: 2.1 time: 0.044607 Aug 08 14:37:58.002724 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 576/1108] 10.222.0.50 () {58 vars in 1413 bytes} [Mon Aug 8 14:37:57 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments/f0c52b0c-9e3a-4752-8f0b-d71603aa7149 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:58.004549 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a3a956a2-4713-4317-9a08-5ccdd4d71faf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:58.006274 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a3a956a2-4713-4317-9a08-5ccdd4d71faf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:58.008036 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a3a956a2-4713-4317-9a08-5ccdd4d71faf tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.206255 Aug 08 14:37:58.008585 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 533/1109] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:57 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:37:58.013498 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9d7208a7-d6c4-489b-b31e-6b7d944c4765 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:58.013992 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9d7208a7-d6c4-489b-b31e-6b7d944c4765 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:58.019809 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9d7208a7-d6c4-489b-b31e-6b7d944c4765 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:58.020822 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9d7208a7-d6c4-489b-b31e-6b7d944c4765 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:58.021265 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9d7208a7-d6c4-489b-b31e-6b7d944c4765 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:58.021954 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9d7208a7-d6c4-489b-b31e-6b7d944c4765 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:58.022437 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9d7208a7-d6c4-489b-b31e-6b7d944c4765 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:58.022863 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9d7208a7-d6c4-489b-b31e-6b7d944c4765 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:58.102740 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-9d7208a7-d6c4-489b-b31e-6b7d944c4765 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lazy-loading 'services' on Instance uuid 2336777d-8558-4c8d-bfcf-9d9959574ba6 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:37:58.175882 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9d7208a7-d6c4-489b-b31e-6b7d944c4765 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments/f0c52b0c-9e3a-4752-8f0b-d71603aa7149" status: 202 len: 0 microversion: 2.1 time: 0.166022 Aug 08 14:37:58.176545 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 577/1110] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 14:37:58 2022] DELETE /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments/f0c52b0c-9e3a-4752-8f0b-d71603aa7149 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:37:58.601325 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-db779a48-17cc-4bed-bdb6-dfec4b09db44 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:58.603741 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-db779a48-17cc-4bed-bdb6-dfec4b09db44 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:58.619628 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-db779a48-17cc-4bed-bdb6-dfec4b09db44 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:58.620120 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-db779a48-17cc-4bed-bdb6-dfec4b09db44 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:58.620677 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-db779a48-17cc-4bed-bdb6-dfec4b09db44 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:58.621411 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-db779a48-17cc-4bed-bdb6-dfec4b09db44 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:58.622112 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-db779a48-17cc-4bed-bdb6-dfec4b09db44 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:58.622732 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-db779a48-17cc-4bed-bdb6-dfec4b09db44 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:58.653899 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-db779a48-17cc-4bed-bdb6-dfec4b09db44 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062495 Aug 08 14:37:58.654770 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 534/1111] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:58 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:37:58.976842 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-33b5c558-8002-4746-a93f-11c013e01135 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:58.977570 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-33b5c558-8002-4746-a93f-11c013e01135 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:58.983756 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-33b5c558-8002-4746-a93f-11c013e01135 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:58.984238 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-33b5c558-8002-4746-a93f-11c013e01135 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:58.984681 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-33b5c558-8002-4746-a93f-11c013e01135 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:58.985371 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-33b5c558-8002-4746-a93f-11c013e01135 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:58.985827 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-33b5c558-8002-4746-a93f-11c013e01135 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:58.986250 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-33b5c558-8002-4746-a93f-11c013e01135 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:59.031487 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f1ff7af6-c4aa-4b53-96d5-58ab2e788413 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:59.032167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f1ff7af6-c4aa-4b53-96d5-58ab2e788413 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:59.038356 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1ff7af6-c4aa-4b53-96d5-58ab2e788413 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:59.038843 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1ff7af6-c4aa-4b53-96d5-58ab2e788413 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:59.039310 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1ff7af6-c4aa-4b53-96d5-58ab2e788413 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:59.040007 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1ff7af6-c4aa-4b53-96d5-58ab2e788413 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:59.040460 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1ff7af6-c4aa-4b53-96d5-58ab2e788413 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:59.040886 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1ff7af6-c4aa-4b53-96d5-58ab2e788413 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:59.181460 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-33b5c558-8002-4746-a93f-11c013e01135 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:59.190150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-33b5c558-8002-4746-a93f-11c013e01135 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1563 microversion: 2.1 time: 0.217965 Aug 08 14:37:59.190731 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 578/1112] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:37:58 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1563 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:37:59.207991 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f1ff7af6-c4aa-4b53-96d5-58ab2e788413 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:59.216077 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f1ff7af6-c4aa-4b53-96d5-58ab2e788413 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:59.217616 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f1ff7af6-c4aa-4b53-96d5-58ab2e788413 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:37:59.218781 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f1ff7af6-c4aa-4b53-96d5-58ab2e788413 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.191393 Aug 08 14:37:59.219381 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 535/1113] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:37:59 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:37:59.666913 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6ea6975c-33d3-4a17-9e2a-942178d8d3dc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:59.669105 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6ea6975c-33d3-4a17-9e2a-942178d8d3dc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:59.674953 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6ea6975c-33d3-4a17-9e2a-942178d8d3dc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:59.675483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6ea6975c-33d3-4a17-9e2a-942178d8d3dc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:59.675919 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6ea6975c-33d3-4a17-9e2a-942178d8d3dc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:59.676662 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6ea6975c-33d3-4a17-9e2a-942178d8d3dc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:59.677119 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6ea6975c-33d3-4a17-9e2a-942178d8d3dc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:59.677540 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6ea6975c-33d3-4a17-9e2a-942178d8d3dc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:59.706093 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6ea6975c-33d3-4a17-9e2a-942178d8d3dc tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043174 Aug 08 14:37:59.706650 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 579/1114] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:37:59 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 14:37:59.717787 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-63f05990-e453-4b4d-9b68-4951d2c0caef tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:37:59.718455 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-63f05990-e453-4b4d-9b68-4951d2c0caef tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:37:59.725745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-63f05990-e453-4b4d-9b68-4951d2c0caef tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:59.726226 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-63f05990-e453-4b4d-9b68-4951d2c0caef tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:59.726711 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-63f05990-e453-4b4d-9b68-4951d2c0caef tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:59.728908 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-63f05990-e453-4b4d-9b68-4951d2c0caef tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:37:59.729404 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-63f05990-e453-4b4d-9b68-4951d2c0caef tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:37:59.729834 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-63f05990-e453-4b4d-9b68-4951d2c0caef tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:37:59.804505 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-63f05990-e453-4b4d-9b68-4951d2c0caef tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] HTTP exception thrown: Instance a7117df5-9606-4392-a933-e624f6e97e2e is not attached to volume 1a96c406-ac1f-4e73-a218-3deec53252fe Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-63f05990-e453-4b4d-9b68-4951d2c0caef tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Request method failure captured: Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: DELETE /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments/1a96c406-ac1f-4e73-a218-3deec53252fe HTTP/1.1 Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R8YNNzSW8o8Xms5pUaFNW0YqIV0oztacrWTF8rtZ6_Mv4CCXeVQ_KasJ-kpok8IArVwxPE9lFnyS12gX6m2ML9jnUfJtMXb4yYye-JIR32VncAI6tBc3feSkZuGfdKNPN-iRW-VfGeJzMQ45bA5ueCcxsf1-VJHzYNxsjDz4hgEq7Y Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 90d6ef85228f4676b9ac19e123e1462a Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-TestMinimumBasicScenario-1327804265 Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:37:59.814458 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:37:59.816298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/90d6ef85228f4676b9ac19e123e1462a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_90d6ef85228f4676b9ac19e123e1462a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90d6ef85228f4676b9ac19e123e1462a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90d6ef85228f4676b9ac19e123e1462a"}]}] Aug 08 14:37:59.816298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-TestMinimumBasicScenario-1327804265 Aug 08 14:37:59.816298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 90d6ef85228f4676b9ac19e123e1462a Aug 08 14:37:59.816298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1327804265 Aug 08 14:37:59.816298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-TestMinimumBasicScenario-1327804265-project Aug 08 14:37:59.816298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:37:59.816298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:37:59.816298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 3cc610fe5d814027b01236949e145430 Aug 08 14:37:59.816298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-TestMinimumBasicScenario-1327804265-project Aug 08 14:37:59.816298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:37:59.816298 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance a7117df5-9606-4392-a933-e624f6e97e2e is not attached to volume 1a96c406-ac1f-4e73-a218-3deec53252fe Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'server_id': 'a7117df5-9606-4392-a933-e624f6e97e2e', 'id': '1a96c406-ac1f-4e73-a218-3deec53252fe'} Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1a96c406-ac1f-4e73-a218-3deec53252fe. Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:37:59.817201 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7117df5-9606-4392-a933-e624f6e97e2e is not attached to volume 1a96c406-ac1f-4e73-a218-3deec53252fe Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7117df5-9606-4392-a933-e624f6e97e2e is not attached to volume 1a96c406-ac1f-4e73-a218-3deec53252fe Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:37:59.818662 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-63f05990-e453-4b4d-9b68-4951d2c0caef tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Returning 404 to user: Instance a7117df5-9606-4392-a933-e624f6e97e2e is not attached to volume 1a96c406-ac1f-4e73-a218-3deec53252fe {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:37:59.819947 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-63f05990-e453-4b4d-9b68-4951d2c0caef tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments/1a96c406-ac1f-4e73-a218-3deec53252fe" status: 404 len: 154 microversion: 2.1 time: 0.102221 Aug 08 14:37:59.819947 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 536/1115] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 14:37:59 2022] DELETE /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e/os-volume_attachments/1a96c406-ac1f-4e73-a218-3deec53252fe => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:00.242751 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bddedd52-bf20-4ad8-9587-d7888292ebd6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:00.243370 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bddedd52-bf20-4ad8-9587-d7888292ebd6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:00.249713 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bddedd52-bf20-4ad8-9587-d7888292ebd6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:00.250195 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bddedd52-bf20-4ad8-9587-d7888292ebd6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:00.250633 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bddedd52-bf20-4ad8-9587-d7888292ebd6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:00.251348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bddedd52-bf20-4ad8-9587-d7888292ebd6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:00.251807 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bddedd52-bf20-4ad8-9587-d7888292ebd6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:00.252231 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bddedd52-bf20-4ad8-9587-d7888292ebd6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:00.358101 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c3e137f6-79ed-4d45-9562-fe8275f20697 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:00.358570 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c3e137f6-79ed-4d45-9562-fe8275f20697 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:00.364922 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c3e137f6-79ed-4d45-9562-fe8275f20697 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:00.365408 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c3e137f6-79ed-4d45-9562-fe8275f20697 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:00.365840 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c3e137f6-79ed-4d45-9562-fe8275f20697 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:00.366542 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c3e137f6-79ed-4d45-9562-fe8275f20697 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:00.366993 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c3e137f6-79ed-4d45-9562-fe8275f20697 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:00.367442 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c3e137f6-79ed-4d45-9562-fe8275f20697 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:00.385385 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bddedd52-bf20-4ad8-9587-d7888292ebd6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:00.388936 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:38:00.394392 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bddedd52-bf20-4ad8-9587-d7888292ebd6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:00.395976 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-bddedd52-bf20-4ad8-9587-d7888292ebd6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:00.396683 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c3e137f6-79ed-4d45-9562-fe8275f20697 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments/8c6ec0c1-642d-4d37-98c1-78df3007a970" status: 200 len: 194 microversion: 2.1 time: 0.042657 Aug 08 14:38:00.397183 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bddedd52-bf20-4ad8-9587-d7888292ebd6 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.158964 Aug 08 14:38:00.397311 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 537/1116] 10.222.0.50 () {58 vars in 1413 bytes} [Mon Aug 8 14:38:00 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments/8c6ec0c1-642d-4d37-98c1-78df3007a970 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:38:00.397735 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 580/1117] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:38:00 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:38:00.407239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d524bab6-1714-4111-9c3d-e9ec3071c8e9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:00.407731 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d524bab6-1714-4111-9c3d-e9ec3071c8e9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:00.413792 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d524bab6-1714-4111-9c3d-e9ec3071c8e9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:00.414275 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d524bab6-1714-4111-9c3d-e9ec3071c8e9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:00.414715 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d524bab6-1714-4111-9c3d-e9ec3071c8e9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:00.415436 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d524bab6-1714-4111-9c3d-e9ec3071c8e9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:00.415889 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d524bab6-1714-4111-9c3d-e9ec3071c8e9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:00.416315 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d524bab6-1714-4111-9c3d-e9ec3071c8e9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:00.493790 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-d524bab6-1714-4111-9c3d-e9ec3071c8e9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lazy-loading 'services' on Instance uuid 2336777d-8558-4c8d-bfcf-9d9959574ba6 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:38:00.566801 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d524bab6-1714-4111-9c3d-e9ec3071c8e9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments/8c6ec0c1-642d-4d37-98c1-78df3007a970" status: 202 len: 0 microversion: 2.1 time: 0.163090 Aug 08 14:38:00.568077 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 538/1118] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 14:38:00 2022] DELETE /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments/8c6ec0c1-642d-4d37-98c1-78df3007a970 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:38:00.693253 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-24cdb6d2-d7c7-4a0e-aa5e-822abd459803 req-f5454c4e-5710-4e16-ba9d-b268d0c56325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79aaf7b-bbdb-42b5-a337-89102612ff93", "name": "network-vif-plugged", "status": "completed", "tag": "9bfd7cef-c545-4cf2-8212-293910501379"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:38:00.722053 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-24cdb6d2-d7c7-4a0e-aa5e-822abd459803 req-f5454c4e-5710-4e16-ba9d-b268d0c56325 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:00.722601 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-24cdb6d2-d7c7-4a0e-aa5e-822abd459803 req-f5454c4e-5710-4e16-ba9d-b268d0c56325 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:00.727036 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-24cdb6d2-d7c7-4a0e-aa5e-822abd459803 req-f5454c4e-5710-4e16-ba9d-b268d0c56325 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:00.743548 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-24cdb6d2-d7c7-4a0e-aa5e-822abd459803 req-f5454c4e-5710-4e16-ba9d-b268d0c56325 service nova] Creating event network-vif-plugged:9bfd7cef-c545-4cf2-8212-293910501379 for instance c79aaf7b-bbdb-42b5-a337-89102612ff93 on hv-cinder-85200 Aug 08 14:38:00.748649 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-24cdb6d2-d7c7-4a0e-aa5e-822abd459803 req-f5454c4e-5710-4e16-ba9d-b268d0c56325 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060194 Aug 08 14:38:00.750290 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 581/1119] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:38:00.962619 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6a1fa4fd-fca3-4e15-bd1e-4dc3428fdf70 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:00.963243 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6a1fa4fd-fca3-4e15-bd1e-4dc3428fdf70 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:00.969361 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6a1fa4fd-fca3-4e15-bd1e-4dc3428fdf70 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:00.969847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6a1fa4fd-fca3-4e15-bd1e-4dc3428fdf70 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:00.970289 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6a1fa4fd-fca3-4e15-bd1e-4dc3428fdf70 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:00.971012 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6a1fa4fd-fca3-4e15-bd1e-4dc3428fdf70 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:00.971496 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6a1fa4fd-fca3-4e15-bd1e-4dc3428fdf70 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:00.971923 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6a1fa4fd-fca3-4e15-bd1e-4dc3428fdf70 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:00.997116 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6a1fa4fd-fca3-4e15-bd1e-4dc3428fdf70 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:38:01.072216 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6a1fa4fd-fca3-4e15-bd1e-4dc3428fdf70 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 204 len: 0 microversion: 2.1 time: 0.116204 Aug 08 14:38:01.072808 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 539/1120] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:38:00 2022] DELETE /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:38:01.081707 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-176d43ba-ecdb-4fd7-9a6f-959bb26d9b1e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:01.082409 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-176d43ba-ecdb-4fd7-9a6f-959bb26d9b1e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:01.089672 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-176d43ba-ecdb-4fd7-9a6f-959bb26d9b1e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:01.090153 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-176d43ba-ecdb-4fd7-9a6f-959bb26d9b1e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:01.090592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-176d43ba-ecdb-4fd7-9a6f-959bb26d9b1e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:01.091330 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-176d43ba-ecdb-4fd7-9a6f-959bb26d9b1e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:01.091772 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-176d43ba-ecdb-4fd7-9a6f-959bb26d9b1e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:01.092196 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-176d43ba-ecdb-4fd7-9a6f-959bb26d9b1e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:01.246370 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-176d43ba-ecdb-4fd7-9a6f-959bb26d9b1e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:01.254601 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-176d43ba-ecdb-4fd7-9a6f-959bb26d9b1e tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1554 microversion: 2.1 time: 0.177220 Aug 08 14:38:01.255373 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 582/1121] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:01 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:01.423330 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b37d6f06-7a96-45c2-b2e1-5966abb7e93f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:01.424285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b37d6f06-7a96-45c2-b2e1-5966abb7e93f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:01.432252 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:38:01.435676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b37d6f06-7a96-45c2-b2e1-5966abb7e93f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:01.436162 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b37d6f06-7a96-45c2-b2e1-5966abb7e93f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:01.436600 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b37d6f06-7a96-45c2-b2e1-5966abb7e93f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:01.437486 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b37d6f06-7a96-45c2-b2e1-5966abb7e93f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:01.437950 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b37d6f06-7a96-45c2-b2e1-5966abb7e93f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:01.438375 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b37d6f06-7a96-45c2-b2e1-5966abb7e93f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:01.573963 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b37d6f06-7a96-45c2-b2e1-5966abb7e93f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:01.583515 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b37d6f06-7a96-45c2-b2e1-5966abb7e93f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:01.585133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b37d6f06-7a96-45c2-b2e1-5966abb7e93f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:01.586309 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b37d6f06-7a96-45c2-b2e1-5966abb7e93f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.167353 Aug 08 14:38:01.586865 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 540/1122] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:38:01 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:38:02.275480 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7055b7bb-8aa8-4c8c-998c-9e6485f60bf0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:02.276263 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7055b7bb-8aa8-4c8c-998c-9e6485f60bf0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:02.283292 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7055b7bb-8aa8-4c8c-998c-9e6485f60bf0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:02.283780 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7055b7bb-8aa8-4c8c-998c-9e6485f60bf0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:02.284215 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7055b7bb-8aa8-4c8c-998c-9e6485f60bf0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:02.284909 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7055b7bb-8aa8-4c8c-998c-9e6485f60bf0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:02.285359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7055b7bb-8aa8-4c8c-998c-9e6485f60bf0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:02.286525 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7055b7bb-8aa8-4c8c-998c-9e6485f60bf0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:02.423910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7055b7bb-8aa8-4c8c-998c-9e6485f60bf0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:02.435224 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7055b7bb-8aa8-4c8c-998c-9e6485f60bf0 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1554 microversion: 2.1 time: 0.160712 Aug 08 14:38:02.435224 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 583/1123] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:02 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:02.607978 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-57abfe35-4304-4485-84f8-068b8f579007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:02.608586 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-57abfe35-4304-4485-84f8-068b8f579007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:02.614979 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-57abfe35-4304-4485-84f8-068b8f579007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:02.615512 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-57abfe35-4304-4485-84f8-068b8f579007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:02.615957 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-57abfe35-4304-4485-84f8-068b8f579007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:02.616648 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-57abfe35-4304-4485-84f8-068b8f579007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:02.617100 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-57abfe35-4304-4485-84f8-068b8f579007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:02.617527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-57abfe35-4304-4485-84f8-068b8f579007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:02.763376 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-57abfe35-4304-4485-84f8-068b8f579007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:02.772486 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-57abfe35-4304-4485-84f8-068b8f579007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:02.774066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-57abfe35-4304-4485-84f8-068b8f579007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:02.775271 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-57abfe35-4304-4485-84f8-068b8f579007 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.171194 Aug 08 14:38:02.775851 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 541/1124] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:38:02 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:38:03.454071 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-93cd3db6-184e-40b6-8b91-350550826fad tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:03.454686 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-93cd3db6-184e-40b6-8b91-350550826fad tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:03.461283 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-93cd3db6-184e-40b6-8b91-350550826fad tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:03.461771 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-93cd3db6-184e-40b6-8b91-350550826fad tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:03.462212 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-93cd3db6-184e-40b6-8b91-350550826fad tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:03.462908 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-93cd3db6-184e-40b6-8b91-350550826fad tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:03.463565 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-93cd3db6-184e-40b6-8b91-350550826fad tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:03.464158 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-93cd3db6-184e-40b6-8b91-350550826fad tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:03.602978 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-93cd3db6-184e-40b6-8b91-350550826fad tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:03.610646 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-93cd3db6-184e-40b6-8b91-350550826fad tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1554 microversion: 2.1 time: 0.161145 Aug 08 14:38:03.611329 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 584/1125] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:03 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:03.799532 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0caf37e9-1584-42fb-927e-3a06c01372b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:03.800145 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0caf37e9-1584-42fb-927e-3a06c01372b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:03.809026 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0caf37e9-1584-42fb-927e-3a06c01372b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:03.810041 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0caf37e9-1584-42fb-927e-3a06c01372b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:03.810831 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0caf37e9-1584-42fb-927e-3a06c01372b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:03.811723 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0caf37e9-1584-42fb-927e-3a06c01372b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:03.812186 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0caf37e9-1584-42fb-927e-3a06c01372b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:03.812802 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0caf37e9-1584-42fb-927e-3a06c01372b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:03.849665 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:38:03.895145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-678b2670-e6a4-4e97-8847-4c0ad83800b8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:03.897790 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-678b2670-e6a4-4e97-8847-4c0ad83800b8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:03.904551 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-678b2670-e6a4-4e97-8847-4c0ad83800b8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:03.905040 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-678b2670-e6a4-4e97-8847-4c0ad83800b8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:03.905642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-678b2670-e6a4-4e97-8847-4c0ad83800b8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:03.906350 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-678b2670-e6a4-4e97-8847-4c0ad83800b8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:03.906971 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-678b2670-e6a4-4e97-8847-4c0ad83800b8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:03.907584 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-678b2670-e6a4-4e97-8847-4c0ad83800b8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:03.938836 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-678b2670-e6a4-4e97-8847-4c0ad83800b8 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048465 Aug 08 14:38:03.939358 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 585/1126] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:38:03 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 14:38:04.063677 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-8c5a37e2-7744-4fa6-9cd6-90d22b8a7ae9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:04.065843 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-8c5a37e2-7744-4fa6-9cd6-90d22b8a7ae9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:04.072497 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8c5a37e2-7744-4fa6-9cd6-90d22b8a7ae9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:04.073269 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8c5a37e2-7744-4fa6-9cd6-90d22b8a7ae9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:04.073706 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8c5a37e2-7744-4fa6-9cd6-90d22b8a7ae9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:04.074599 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8c5a37e2-7744-4fa6-9cd6-90d22b8a7ae9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:04.075060 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8c5a37e2-7744-4fa6-9cd6-90d22b8a7ae9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:04.075517 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-8c5a37e2-7744-4fa6-9cd6-90d22b8a7ae9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:04.106153 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-8c5a37e2-7744-4fa6-9cd6-90d22b8a7ae9 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046382 Aug 08 14:38:04.106722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 586/1127] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:38:04 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 14:38:04.131169 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0caf37e9-1584-42fb-927e-3a06c01372b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:04.144180 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0caf37e9-1584-42fb-927e-3a06c01372b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:04.146666 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0caf37e9-1584-42fb-927e-3a06c01372b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:04.148095 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0caf37e9-1584-42fb-927e-3a06c01372b1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.353130 Aug 08 14:38:04.148532 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 542/1128] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:38:03 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:38:04.198515 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-fb42ea77-278d-4922-8262-9b29178cbaf4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:04.199031 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-fb42ea77-278d-4922-8262-9b29178cbaf4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:04.219117 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fb42ea77-278d-4922-8262-9b29178cbaf4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:04.220197 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fb42ea77-278d-4922-8262-9b29178cbaf4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:04.225358 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fb42ea77-278d-4922-8262-9b29178cbaf4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:04.226334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fb42ea77-278d-4922-8262-9b29178cbaf4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:04.228471 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fb42ea77-278d-4922-8262-9b29178cbaf4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:04.229164 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-fb42ea77-278d-4922-8262-9b29178cbaf4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:04.293487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-fb42ea77-278d-4922-8262-9b29178cbaf4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Going to try to terminate instance {{(pid=118062) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:38:04.406088 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-fb42ea77-278d-4922-8262-9b29178cbaf4 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 204 len: 0 microversion: 2.1 time: 0.218522 Aug 08 14:38:04.407364 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 587/1129] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:38:04 2022] DELETE /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:38:04.417472 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a4531c94-e201-457f-9ea0-cadc0f53621d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:04.418464 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a4531c94-e201-457f-9ea0-cadc0f53621d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:04.425372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a4531c94-e201-457f-9ea0-cadc0f53621d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:04.426320 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a4531c94-e201-457f-9ea0-cadc0f53621d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:04.427263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a4531c94-e201-457f-9ea0-cadc0f53621d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:04.428706 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a4531c94-e201-457f-9ea0-cadc0f53621d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:04.429397 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a4531c94-e201-457f-9ea0-cadc0f53621d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:04.443890 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a4531c94-e201-457f-9ea0-cadc0f53621d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:04.514826 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-518ac3d4-4281-4e25-92aa-108ea5c85095 req-4c5411ed-1753-4deb-ade2-fbe802d69768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7117df5-9606-4392-a933-e624f6e97e2e", "name": "network-vif-deleted", "tag": "d8539c0a-5ff5-4ee6-883f-9961bff24df3"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:38:04.526305 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-518ac3d4-4281-4e25-92aa-108ea5c85095 req-4c5411ed-1753-4deb-ade2-fbe802d69768 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:04.526793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-518ac3d4-4281-4e25-92aa-108ea5c85095 req-4c5411ed-1753-4deb-ade2-fbe802d69768 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:04.527257 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-518ac3d4-4281-4e25-92aa-108ea5c85095 req-4c5411ed-1753-4deb-ade2-fbe802d69768 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:04.545568 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-518ac3d4-4281-4e25-92aa-108ea5c85095 req-4c5411ed-1753-4deb-ade2-fbe802d69768 service nova] Creating event network-vif-deleted:d8539c0a-5ff5-4ee6-883f-9961bff24df3 for instance a7117df5-9606-4392-a933-e624f6e97e2e on hv-cinder-85200 Aug 08 14:38:04.551182 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-518ac3d4-4281-4e25-92aa-108ea5c85095 req-4c5411ed-1753-4deb-ade2-fbe802d69768 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041641 Aug 08 14:38:04.552138 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 588/1130] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:38:04.635880 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-16c66a36-3396-4e33-81e0-51a01f212520 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:04.636975 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-16c66a36-3396-4e33-81e0-51a01f212520 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:04.651345 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16c66a36-3396-4e33-81e0-51a01f212520 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:04.653201 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16c66a36-3396-4e33-81e0-51a01f212520 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:04.654036 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16c66a36-3396-4e33-81e0-51a01f212520 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:04.654911 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16c66a36-3396-4e33-81e0-51a01f212520 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:04.655585 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16c66a36-3396-4e33-81e0-51a01f212520 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:04.656125 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-16c66a36-3396-4e33-81e0-51a01f212520 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:04.682270 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a4531c94-e201-457f-9ea0-cadc0f53621d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:04.697226 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a4531c94-e201-457f-9ea0-cadc0f53621d tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 200 len: 1675 microversion: 2.1 time: 0.282828 Aug 08 14:38:04.698896 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 543/1131] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:04 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 1675 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:04.788333 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-16c66a36-3396-4e33-81e0-51a01f212520 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:04.804049 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-16c66a36-3396-4e33-81e0-51a01f212520 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1512 microversion: 2.1 time: 0.176227 Aug 08 14:38:04.805596 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 589/1132] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:04 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:05.172677 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-584f2419-30a3-4b93-a2a5-b78382dbdac1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:05.173433 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-584f2419-30a3-4b93-a2a5-b78382dbdac1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:05.181132 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-584f2419-30a3-4b93-a2a5-b78382dbdac1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:05.181699 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-584f2419-30a3-4b93-a2a5-b78382dbdac1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:05.182209 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-584f2419-30a3-4b93-a2a5-b78382dbdac1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:05.183012 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-584f2419-30a3-4b93-a2a5-b78382dbdac1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:05.183832 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-584f2419-30a3-4b93-a2a5-b78382dbdac1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:05.184047 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-584f2419-30a3-4b93-a2a5-b78382dbdac1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:05.361788 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-584f2419-30a3-4b93-a2a5-b78382dbdac1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:05.378710 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-584f2419-30a3-4b93-a2a5-b78382dbdac1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:05.380279 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-584f2419-30a3-4b93-a2a5-b78382dbdac1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:05.381457 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-584f2419-30a3-4b93-a2a5-b78382dbdac1 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.213145 Aug 08 14:38:05.382012 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 544/1133] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:38:05 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:38:05.724197 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-675c18b3-3885-464d-aa5d-3ed6a88a3f97 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:05.724890 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-675c18b3-3885-464d-aa5d-3ed6a88a3f97 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:05.731192 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-675c18b3-3885-464d-aa5d-3ed6a88a3f97 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:05.731673 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-675c18b3-3885-464d-aa5d-3ed6a88a3f97 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:05.732109 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-675c18b3-3885-464d-aa5d-3ed6a88a3f97 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:05.732796 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-675c18b3-3885-464d-aa5d-3ed6a88a3f97 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:05.733246 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-675c18b3-3885-464d-aa5d-3ed6a88a3f97 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:05.733665 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-675c18b3-3885-464d-aa5d-3ed6a88a3f97 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:05.825682 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ad25fe7d-a9e1-4e34-84a8-1c4a58285474 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:05.826432 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ad25fe7d-a9e1-4e34-84a8-1c4a58285474 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:05.833197 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad25fe7d-a9e1-4e34-84a8-1c4a58285474 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:05.833757 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad25fe7d-a9e1-4e34-84a8-1c4a58285474 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:05.834266 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad25fe7d-a9e1-4e34-84a8-1c4a58285474 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:05.835038 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad25fe7d-a9e1-4e34-84a8-1c4a58285474 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:05.835602 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad25fe7d-a9e1-4e34-84a8-1c4a58285474 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:05.836093 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad25fe7d-a9e1-4e34-84a8-1c4a58285474 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:05.868833 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad25fe7d-a9e1-4e34-84a8-1c4a58285474 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:05.869404 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad25fe7d-a9e1-4e34-84a8-1c4a58285474 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:05.870064 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad25fe7d-a9e1-4e34-84a8-1c4a58285474 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:05.870581 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-ad25fe7d-a9e1-4e34-84a8-1c4a58285474 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lazy-loading 'fault' on Instance uuid a7117df5-9606-4392-a933-e624f6e97e2e {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:38:05.877049 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-675c18b3-3885-464d-aa5d-3ed6a88a3f97 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:05.885615 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-675c18b3-3885-464d-aa5d-3ed6a88a3f97 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 200 len: 1675 microversion: 2.1 time: 0.165876 Aug 08 14:38:05.886183 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 590/1134] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:05 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:05.918528 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ad25fe7d-a9e1-4e34-84a8-1c4a58285474 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:05.926116 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ad25fe7d-a9e1-4e34-84a8-1c4a58285474 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1349 microversion: 2.1 time: 0.104251 Aug 08 14:38:05.926718 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 545/1135] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:05 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:38:06.405745 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1f968d8b-a08e-4921-a0a7-17ebf6e3b80d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:06.406361 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1f968d8b-a08e-4921-a0a7-17ebf6e3b80d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:06.413104 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1f968d8b-a08e-4921-a0a7-17ebf6e3b80d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:06.413841 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1f968d8b-a08e-4921-a0a7-17ebf6e3b80d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:06.414508 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1f968d8b-a08e-4921-a0a7-17ebf6e3b80d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:06.415289 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1f968d8b-a08e-4921-a0a7-17ebf6e3b80d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:06.415910 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1f968d8b-a08e-4921-a0a7-17ebf6e3b80d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:06.416342 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1f968d8b-a08e-4921-a0a7-17ebf6e3b80d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:06.558038 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-1f968d8b-a08e-4921-a0a7-17ebf6e3b80d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:06.566290 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-1f968d8b-a08e-4921-a0a7-17ebf6e3b80d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:06.568482 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-1f968d8b-a08e-4921-a0a7-17ebf6e3b80d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:06.569756 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1f968d8b-a08e-4921-a0a7-17ebf6e3b80d tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1730 microversion: 2.20 time: 0.168621 Aug 08 14:38:06.570416 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 591/1136] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:38:06 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:38:06.907823 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-985f94c6-2372-4e50-bb03-0e5a27775973 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:06.908595 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-985f94c6-2372-4e50-bb03-0e5a27775973 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:06.924436 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-985f94c6-2372-4e50-bb03-0e5a27775973 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:06.926064 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-985f94c6-2372-4e50-bb03-0e5a27775973 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:06.928000 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-985f94c6-2372-4e50-bb03-0e5a27775973 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:06.930946 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-985f94c6-2372-4e50-bb03-0e5a27775973 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:06.931557 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-985f94c6-2372-4e50-bb03-0e5a27775973 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:06.933197 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-985f94c6-2372-4e50-bb03-0e5a27775973 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:06.946845 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-832d0d57-1dcf-43ab-b454-c3a6858cc789 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:06.947666 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-832d0d57-1dcf-43ab-b454-c3a6858cc789 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:06.958673 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-832d0d57-1dcf-43ab-b454-c3a6858cc789 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:06.971378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-832d0d57-1dcf-43ab-b454-c3a6858cc789 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:06.971378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-832d0d57-1dcf-43ab-b454-c3a6858cc789 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:06.974404 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-832d0d57-1dcf-43ab-b454-c3a6858cc789 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:06.974969 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-832d0d57-1dcf-43ab-b454-c3a6858cc789 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:06.975548 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-832d0d57-1dcf-43ab-b454-c3a6858cc789 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:07.097804 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-832d0d57-1dcf-43ab-b454-c3a6858cc789 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:07.098852 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-832d0d57-1dcf-43ab-b454-c3a6858cc789 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:07.099508 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-832d0d57-1dcf-43ab-b454-c3a6858cc789 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:07.100142 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-832d0d57-1dcf-43ab-b454-c3a6858cc789 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lazy-loading 'fault' on Instance uuid a7117df5-9606-4392-a933-e624f6e97e2e {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:38:07.181526 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-832d0d57-1dcf-43ab-b454-c3a6858cc789 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc610fe5d814027b01236949e145430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d6ef85228f4676b9ac19e123e1462a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:07.190610 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-832d0d57-1dcf-43ab-b454-c3a6858cc789 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 200 len: 1349 microversion: 2.1 time: 0.248132 Aug 08 14:38:07.199776 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 592/1137] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:06 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 1349 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:38:07.304680 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-985f94c6-2372-4e50-bb03-0e5a27775973 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:07.312615 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-985f94c6-2372-4e50-bb03-0e5a27775973 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 200 len: 1675 microversion: 2.1 time: 0.408744 Aug 08 14:38:07.313226 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 546/1138] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:06 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 1675 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:07.594721 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9a5ba980-02ba-4984-a453-9cdc026ac24f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:07.595389 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9a5ba980-02ba-4984-a453-9cdc026ac24f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:07.602054 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9a5ba980-02ba-4984-a453-9cdc026ac24f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:07.602593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9a5ba980-02ba-4984-a453-9cdc026ac24f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:07.603034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9a5ba980-02ba-4984-a453-9cdc026ac24f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:07.603765 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9a5ba980-02ba-4984-a453-9cdc026ac24f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:07.604221 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9a5ba980-02ba-4984-a453-9cdc026ac24f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:07.604645 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9a5ba980-02ba-4984-a453-9cdc026ac24f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:07.822455 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9a5ba980-02ba-4984-a453-9cdc026ac24f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:07.830504 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9a5ba980-02ba-4984-a453-9cdc026ac24f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:07.832651 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-9a5ba980-02ba-4984-a453-9cdc026ac24f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:07.833835 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9a5ba980-02ba-4984-a453-9cdc026ac24f tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1717 microversion: 2.20 time: 0.243558 Aug 08 14:38:07.834392 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 593/1139] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:38:07 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1717 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:38:07.986721 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-127c7b08-7c4f-457c-975e-b6b93944b882 req-ee60a92a-2fd4-4d4d-8b8d-c23176c593f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2336777d-8558-4c8d-bfcf-9d9959574ba6", "name": "network-vif-deleted", "tag": "c33a1d22-777b-4ccc-9d64-6225c5227a29"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:38:08.002156 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-127c7b08-7c4f-457c-975e-b6b93944b882 req-ee60a92a-2fd4-4d4d-8b8d-c23176c593f2 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:08.003426 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-127c7b08-7c4f-457c-975e-b6b93944b882 req-ee60a92a-2fd4-4d4d-8b8d-c23176c593f2 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:08.004018 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-127c7b08-7c4f-457c-975e-b6b93944b882 req-ee60a92a-2fd4-4d4d-8b8d-c23176c593f2 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:08.018725 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-127c7b08-7c4f-457c-975e-b6b93944b882 req-ee60a92a-2fd4-4d4d-8b8d-c23176c593f2 service nova] Creating event network-vif-deleted:c33a1d22-777b-4ccc-9d64-6225c5227a29 for instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 on hv-cinder-85200 Aug 08 14:38:08.027840 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-127c7b08-7c4f-457c-975e-b6b93944b882 req-ee60a92a-2fd4-4d4d-8b8d-c23176c593f2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044675 Aug 08 14:38:08.028434 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 547/1140] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:38:08.216292 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-72ee2ec5-3496-4a3a-b865-9edfbf266f00 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:08.216826 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-72ee2ec5-3496-4a3a-b865-9edfbf266f00 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] [instance: a7117df5-9606-4392-a933-e624f6e97e2e] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:08.223343 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-72ee2ec5-3496-4a3a-b865-9edfbf266f00 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:08.223832 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-72ee2ec5-3496-4a3a-b865-9edfbf266f00 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:08.224271 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-72ee2ec5-3496-4a3a-b865-9edfbf266f00 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:08.225012 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-72ee2ec5-3496-4a3a-b865-9edfbf266f00 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:08.225429 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-72ee2ec5-3496-4a3a-b865-9edfbf266f00 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:08.226038 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-72ee2ec5-3496-4a3a-b865-9edfbf266f00 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:08.239387 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-72ee2ec5-3496-4a3a-b865-9edfbf266f00 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] HTTP exception thrown: Instance a7117df5-9606-4392-a933-e624f6e97e2e could not be found. Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-72ee2ec5-3496-4a3a-b865-9edfbf266f00 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Request method failure captured: Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e HTTP/1.1 Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R8YNNzSW8o8Xms5pUaFNW0YqIV0oztacrWTF8rtZ6_Mv4CCXeVQ_KasJ-kpok8IArVwxPE9lFnyS12gX6m2ML9jnUfJtMXb4yYye-JIR32VncAI6tBc3feSkZuGfdKNPN-iRW-VfGeJzMQ45bA5ueCcxsf1-VJHzYNxsjDz4hgEq7Y Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 90d6ef85228f4676b9ac19e123e1462a Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-TestMinimumBasicScenario-1327804265 Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:38:08.241048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:38:08.242553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/90d6ef85228f4676b9ac19e123e1462a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_90d6ef85228f4676b9ac19e123e1462a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90d6ef85228f4676b9ac19e123e1462a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90d6ef85228f4676b9ac19e123e1462a"}]}] Aug 08 14:38:08.242553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-TestMinimumBasicScenario-1327804265 Aug 08 14:38:08.242553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 90d6ef85228f4676b9ac19e123e1462a Aug 08 14:38:08.242553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1327804265 Aug 08 14:38:08.242553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-TestMinimumBasicScenario-1327804265-project Aug 08 14:38:08.242553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:38:08.242553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:38:08.242553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 3cc610fe5d814027b01236949e145430 Aug 08 14:38:08.242553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-TestMinimumBasicScenario-1327804265-project Aug 08 14:38:08.242553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:38:08.242553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance a7117df5-9606-4392-a933-e624f6e97e2e could not be found. Aug 08 14:38:08.242553 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': 'a7117df5-9606-4392-a933-e624f6e97e2e'} Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7117df5-9606-4392-a933-e624f6e97e2e could not be found. Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:08.243484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7117df5-9606-4392-a933-e624f6e97e2e could not be found. Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7117df5-9606-4392-a933-e624f6e97e2e could not be found. Aug 08 14:38:08.244793 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:08.245880 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-72ee2ec5-3496-4a3a-b865-9edfbf266f00 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Returning 404 to user: Instance a7117df5-9606-4392-a933-e624f6e97e2e could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:08.245880 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-72ee2ec5-3496-4a3a-b865-9edfbf266f00 tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e" status: 404 len: 111 microversion: 2.1 time: 0.030120 Aug 08 14:38:08.245880 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 594/1141] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:08 2022] GET /compute/v2.1/servers/a7117df5-9606-4392-a933-e624f6e97e2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:08.251863 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c5caa50d-708a-47bd-813e-597b5543690f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] Calling method '.version_select at 0x7f9cb26254c0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:08.271594 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c5caa50d-708a-47bd-813e-597b5543690f tempest-TestMinimumBasicScenario-1327804265 tempest-TestMinimumBasicScenario-1327804265-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2050739285" status: 202 len: 0 microversion: 2.1 time: 0.023877 Aug 08 14:38:08.272169 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 548/1142] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Aug 8 14:38:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2050739285 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:38:08.335741 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-eee32d53-f1f3-4355-933d-33f26faa2ac6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:08.336275 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-eee32d53-f1f3-4355-933d-33f26faa2ac6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:08.342690 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eee32d53-f1f3-4355-933d-33f26faa2ac6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:08.343370 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eee32d53-f1f3-4355-933d-33f26faa2ac6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:08.343903 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eee32d53-f1f3-4355-933d-33f26faa2ac6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:08.344822 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eee32d53-f1f3-4355-933d-33f26faa2ac6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:08.345367 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eee32d53-f1f3-4355-933d-33f26faa2ac6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:08.345974 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eee32d53-f1f3-4355-933d-33f26faa2ac6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:08.384292 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eee32d53-f1f3-4355-933d-33f26faa2ac6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:08.385696 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eee32d53-f1f3-4355-933d-33f26faa2ac6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:08.386616 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eee32d53-f1f3-4355-933d-33f26faa2ac6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:08.387268 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-eee32d53-f1f3-4355-933d-33f26faa2ac6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lazy-loading 'fault' on Instance uuid 2336777d-8558-4c8d-bfcf-9d9959574ba6 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:38:08.450611 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-eee32d53-f1f3-4355-933d-33f26faa2ac6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b75be070a147fba4788b0f51d8d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400861a88074a1480b54ce5e651cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:08.462549 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-eee32d53-f1f3-4355-933d-33f26faa2ac6 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 200 len: 1328 microversion: 2.1 time: 0.132569 Aug 08 14:38:08.463341 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 595/1143] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:08 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 1328 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:09.485165 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-64d3f233-1a5e-4292-b601-f780899c4779 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:09.485894 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-64d3f233-1a5e-4292-b601-f780899c4779 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:09.492488 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64d3f233-1a5e-4292-b601-f780899c4779 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:09.492969 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64d3f233-1a5e-4292-b601-f780899c4779 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:09.493414 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64d3f233-1a5e-4292-b601-f780899c4779 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:09.494110 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64d3f233-1a5e-4292-b601-f780899c4779 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:09.494564 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64d3f233-1a5e-4292-b601-f780899c4779 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:09.494989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64d3f233-1a5e-4292-b601-f780899c4779 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:09.508962 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-64d3f233-1a5e-4292-b601-f780899c4779 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] HTTP exception thrown: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-64d3f233-1a5e-4292-b601-f780899c4779 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Request method failure captured: Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 HTTP/1.1 Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4krfH33h-RX4izJJDTSVG0g4ILn0N57NAFeoqYn8g7QS4HpLjKpfsLIP8ZWT12akAoH26m_fwmGqVsgmFaHbNUwKyQ0pgB0hTKrei-TDO9eeIZKJoWGFsG8zhRMe3wzi4wDoPECfUZDg3DA4C9FuxMWkvSNJPrBM1YAG8kagi_miM Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 0400861a88074a1480b54ce5e651cc76 Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:38:09.510743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:38:09.512118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0400861a88074a1480b54ce5e651cc76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0400861a88074a1480b54ce5e651cc76", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0400861a88074a1480b54ce5e651cc76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0400861a88074a1480b54ce5e651cc76"}]}] Aug 08 14:38:09.512118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:09.512118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 0400861a88074a1480b54ce5e651cc76 Aug 08 14:38:09.512118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:09.512118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeTestJSON-1772828726-project Aug 08 14:38:09.512118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:38:09.512118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:38:09.512118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 75b75be070a147fba4788b0f51d8d0fb Aug 08 14:38:09.512118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeTestJSON-1772828726-project Aug 08 14:38:09.512118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:38:09.512118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:09.512118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '2336777d-8558-4c8d-bfcf-9d9959574ba6'} Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:09.512942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:09.514107 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:09.515267 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-64d3f233-1a5e-4292-b601-f780899c4779 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Returning 404 to user: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:09.515267 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-64d3f233-1a5e-4292-b601-f780899c4779 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 404 len: 111 microversion: 2.1 time: 0.031545 Aug 08 14:38:09.515267 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 549/1144] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:09 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:09.521118 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-da85a88a-f8ca-4f01-b060-7dfe21059785 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '.version_select at 0x7f9cb25dd700>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:09.540503 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-da85a88a-f8ca-4f01-b060-7dfe21059785 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840340557" status: 202 len: 0 microversion: 2.1 time: 0.023176 Aug 08 14:38:09.541075 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 596/1145] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Aug 8 14:38:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840340557 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:38:12.734665 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f9c81333-1511-4c77-97ab-d2d2c06e1a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:12.735232 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f9c81333-1511-4c77-97ab-d2d2c06e1a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:12.741794 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f9c81333-1511-4c77-97ab-d2d2c06e1a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:12.742281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f9c81333-1511-4c77-97ab-d2d2c06e1a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:12.742711 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f9c81333-1511-4c77-97ab-d2d2c06e1a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:12.743573 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f9c81333-1511-4c77-97ab-d2d2c06e1a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:12.744436 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f9c81333-1511-4c77-97ab-d2d2c06e1a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:12.744959 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f9c81333-1511-4c77-97ab-d2d2c06e1a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:12.759444 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-f9c81333-1511-4c77-97ab-d2d2c06e1a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] HTTP exception thrown: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f9c81333-1511-4c77-97ab-d2d2c06e1a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Request method failure captured: Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: DELETE /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 HTTP/1.1 Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4krfH33h-RX4izJJDTSVG0g4ILn0N57NAFeoqYn8g7QS4HpLjKpfsLIP8ZWT12akAoH26m_fwmGqVsgmFaHbNUwKyQ0pgB0hTKrei-TDO9eeIZKJoWGFsG8zhRMe3wzi4wDoPECfUZDg3DA4C9FuxMWkvSNJPrBM1YAG8kagi_miM Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 0400861a88074a1480b54ce5e651cc76 Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:38:12.761019 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:38:12.762657 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0400861a88074a1480b54ce5e651cc76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0400861a88074a1480b54ce5e651cc76", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0400861a88074a1480b54ce5e651cc76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0400861a88074a1480b54ce5e651cc76"}]}] Aug 08 14:38:12.762657 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:12.762657 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 0400861a88074a1480b54ce5e651cc76 Aug 08 14:38:12.762657 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:12.762657 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeTestJSON-1772828726-project Aug 08 14:38:12.762657 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:38:12.762657 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:38:12.762657 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 75b75be070a147fba4788b0f51d8d0fb Aug 08 14:38:12.762657 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeTestJSON-1772828726-project Aug 08 14:38:12.762657 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:38:12.762657 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:12.762657 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '2336777d-8558-4c8d-bfcf-9d9959574ba6'} Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:12.763703 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:12.765135 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:12.766525 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f9c81333-1511-4c77-97ab-d2d2c06e1a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Returning 404 to user: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:12.766525 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f9c81333-1511-4c77-97ab-d2d2c06e1a49 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 404 len: 111 microversion: 2.1 time: 0.031945 Aug 08 14:38:12.766525 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 550/1146] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:38:12 2022] DELETE /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:12.776513 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-aefd0b79-f102-4f26-8cd0-f177a60846a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:12.777135 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-aefd0b79-f102-4f26-8cd0-f177a60846a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: 2336777d-8558-4c8d-bfcf-9d9959574ba6] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:12.783795 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aefd0b79-f102-4f26-8cd0-f177a60846a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:12.784294 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aefd0b79-f102-4f26-8cd0-f177a60846a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:12.784735 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aefd0b79-f102-4f26-8cd0-f177a60846a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:12.785483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aefd0b79-f102-4f26-8cd0-f177a60846a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:12.786197 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aefd0b79-f102-4f26-8cd0-f177a60846a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:12.786625 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-aefd0b79-f102-4f26-8cd0-f177a60846a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:12.801590 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-aefd0b79-f102-4f26-8cd0-f177a60846a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] HTTP exception thrown: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-aefd0b79-f102-4f26-8cd0-f177a60846a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Request method failure captured: Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 HTTP/1.1 Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4krfH33h-RX4izJJDTSVG0g4ILn0N57NAFeoqYn8g7QS4HpLjKpfsLIP8ZWT12akAoH26m_fwmGqVsgmFaHbNUwKyQ0pgB0hTKrei-TDO9eeIZKJoWGFsG8zhRMe3wzi4wDoPECfUZDg3DA4C9FuxMWkvSNJPrBM1YAG8kagi_miM Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 0400861a88074a1480b54ce5e651cc76 Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:38:12.803228 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:38:12.804619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0400861a88074a1480b54ce5e651cc76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0400861a88074a1480b54ce5e651cc76", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0400861a88074a1480b54ce5e651cc76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0400861a88074a1480b54ce5e651cc76"}]}] Aug 08 14:38:12.804619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:12.804619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 0400861a88074a1480b54ce5e651cc76 Aug 08 14:38:12.804619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:12.804619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-AttachVolumeTestJSON-1772828726-project Aug 08 14:38:12.804619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:38:12.804619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:38:12.804619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 75b75be070a147fba4788b0f51d8d0fb Aug 08 14:38:12.804619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-AttachVolumeTestJSON-1772828726-project Aug 08 14:38:12.804619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:38:12.804619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:12.804619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': '2336777d-8558-4c8d-bfcf-9d9959574ba6'} Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:12.805413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. Aug 08 14:38:12.806799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:12.808301 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-aefd0b79-f102-4f26-8cd0-f177a60846a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Returning 404 to user: Instance 2336777d-8558-4c8d-bfcf-9d9959574ba6 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:12.808301 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-aefd0b79-f102-4f26-8cd0-f177a60846a1 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6" status: 404 len: 111 microversion: 2.1 time: 0.032790 Aug 08 14:38:12.809059 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 597/1147] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:12 2022] GET /compute/v2.1/servers/2336777d-8558-4c8d-bfcf-9d9959574ba6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:13.971867 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1cabdebd-12bf-4774-8066-d2ca51d4de43 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:13.972354 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1cabdebd-12bf-4774-8066-d2ca51d4de43 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:13.980058 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1cabdebd-12bf-4774-8066-d2ca51d4de43 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:13.980555 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1cabdebd-12bf-4774-8066-d2ca51d4de43 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:13.980998 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1cabdebd-12bf-4774-8066-d2ca51d4de43 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:13.981712 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1cabdebd-12bf-4774-8066-d2ca51d4de43 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:13.982171 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1cabdebd-12bf-4774-8066-d2ca51d4de43 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:13.982600 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1cabdebd-12bf-4774-8066-d2ca51d4de43 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:13.998125 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-1cabdebd-12bf-4774-8066-d2ca51d4de43 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] HTTP exception thrown: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1cabdebd-12bf-4774-8066-d2ca51d4de43 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Request method failure captured: Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: DELETE /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b HTTP/1.1 Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4krfH33h-RX4izJJDTSVG0g4ILn0N57NAFeoqYn8g7QS4HpLjKpfsLIP8ZWT12akAoH26m_fwmGqVsgmFaHbNUwKyQ0pgB0hTKrei-TDO9eeIZKJoWGFsG8zhRMe3wzi4wDoPECfUZDg3DA4C9FuxMWkvSNJPrBM1YAG8kagi_miM Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 0400861a88074a1480b54ce5e651cc76 Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:38:13.999745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:38:14.001118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0400861a88074a1480b54ce5e651cc76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0400861a88074a1480b54ce5e651cc76", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0400861a88074a1480b54ce5e651cc76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0400861a88074a1480b54ce5e651cc76"}]}] Aug 08 14:38:14.001118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:14.001118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 0400861a88074a1480b54ce5e651cc76 Aug 08 14:38:14.001118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:14.001118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeTestJSON-1772828726-project Aug 08 14:38:14.001118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:38:14.001118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:38:14.001118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 75b75be070a147fba4788b0f51d8d0fb Aug 08 14:38:14.001118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeTestJSON-1772828726-project Aug 08 14:38:14.001118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:38:14.001118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:38:14.001118 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'b4c76439-3c30-47b1-a13c-cee630ea057b'} Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:14.001847 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:38:14.003167 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:14.004457 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1cabdebd-12bf-4774-8066-d2ca51d4de43 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Returning 404 to user: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:14.004457 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1cabdebd-12bf-4774-8066-d2ca51d4de43 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 404 len: 111 microversion: 2.1 time: 0.033182 Aug 08 14:38:14.004457 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 551/1148] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:38:13 2022] DELETE /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:14.010724 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-adc94771-e1e2-412b-8079-8c1b16b15ec3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:14.011383 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-adc94771-e1e2-412b-8079-8c1b16b15ec3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] [instance: b4c76439-3c30-47b1-a13c-cee630ea057b] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:14.017534 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-adc94771-e1e2-412b-8079-8c1b16b15ec3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:14.018025 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-adc94771-e1e2-412b-8079-8c1b16b15ec3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:14.018467 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-adc94771-e1e2-412b-8079-8c1b16b15ec3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:14.019229 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-adc94771-e1e2-412b-8079-8c1b16b15ec3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:14.020236 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-adc94771-e1e2-412b-8079-8c1b16b15ec3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:14.020674 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-adc94771-e1e2-412b-8079-8c1b16b15ec3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:14.042348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-adc94771-e1e2-412b-8079-8c1b16b15ec3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] HTTP exception thrown: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-adc94771-e1e2-412b-8079-8c1b16b15ec3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Request method failure captured: Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b HTTP/1.1 Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4krfH33h-RX4izJJDTSVG0g4ILn0N57NAFeoqYn8g7QS4HpLjKpfsLIP8ZWT12akAoH26m_fwmGqVsgmFaHbNUwKyQ0pgB0hTKrei-TDO9eeIZKJoWGFsG8zhRMe3wzi4wDoPECfUZDg3DA4C9FuxMWkvSNJPrBM1YAG8kagi_miM Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 0400861a88074a1480b54ce5e651cc76 Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:38:14.044430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:38:14.046004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0400861a88074a1480b54ce5e651cc76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0400861a88074a1480b54ce5e651cc76", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0400861a88074a1480b54ce5e651cc76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0400861a88074a1480b54ce5e651cc76"}]}] Aug 08 14:38:14.046004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:14.046004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 0400861a88074a1480b54ce5e651cc76 Aug 08 14:38:14.046004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1772828726 Aug 08 14:38:14.046004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-AttachVolumeTestJSON-1772828726-project Aug 08 14:38:14.046004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:38:14.046004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:38:14.046004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 75b75be070a147fba4788b0f51d8d0fb Aug 08 14:38:14.046004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-AttachVolumeTestJSON-1772828726-project Aug 08 14:38:14.046004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:38:14.046004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:38:14.046004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': 'b4c76439-3c30-47b1-a13c-cee630ea057b'} Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:14.047535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. Aug 08 14:38:14.048718 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:14.049820 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-adc94771-e1e2-412b-8079-8c1b16b15ec3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] Returning 404 to user: Instance b4c76439-3c30-47b1-a13c-cee630ea057b could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:14.049820 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-adc94771-e1e2-412b-8079-8c1b16b15ec3 tempest-AttachVolumeTestJSON-1772828726 tempest-AttachVolumeTestJSON-1772828726-project] 10.222.0.50 "GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b" status: 404 len: 111 microversion: 2.1 time: 0.040080 Aug 08 14:38:14.049820 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 598/1149] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:14 2022] GET /compute/v2.1/servers/b4c76439-3c30-47b1-a13c-cee630ea057b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:21.684928 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-365830689", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1484870203", "security_groups": [{"name": "tempest-secgroup-smoke-95557263"}], "block_device_mapping_v2": [{"uuid": "0b13bcb1-1a44-4649-828a-a8fd54398d97", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7a23184-1226-4562-af07-174dc1a651ae"}]}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:38:21.796128 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] validate_networks() for [('f7a23184-1226-4562-af07-174dc1a651ae', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 14:38:22.155801 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 14:38:22.156224 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 14:38:22.156807 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 14:38:22.157094 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 14:38:22.157503 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 14:38:22.167351 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:22.167934 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:22.168469 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:22.169270 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:22.169866 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:22.170359 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:22.188699 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Getting quotas for project 8aac3d3b720c45e8817bda1fe4d2d157. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 14:38:22.195921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Getting quotas for user 2495d3c63dc44049872afb908ca6133b and project 8aac3d3b720c45e8817bda1fe4d2d157. Resources: {'instances', 'cores', 'ram'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 14:38:22.260507 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 14:38:22.262647 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b13bcb1-1a44-4649-828a-a8fd54398d97',volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 14:38:22.390955 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-78a26b80-9846-4e24-b75f-3a5d28dfeb2f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.709843 Aug 08 14:38:22.391819 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 552/1150] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 14:38:21 2022] POST /compute/v2.1/servers => generated 404 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 14:38:22.402281 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1685483b-0c55-4017-a798-2a8133fceaab tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:22.402962 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1685483b-0c55-4017-a798-2a8133fceaab tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:22.461971 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-1685483b-0c55-4017-a798-2a8133fceaab tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:22.468957 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1685483b-0c55-4017-a798-2a8133fceaab tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1094 microversion: 2.1 time: 0.070508 Aug 08 14:38:22.469972 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 599/1151] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:22 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:23.490729 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-06fa470a-010c-47e4-a117-4a61c6867b98 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:23.492018 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-06fa470a-010c-47e4-a117-4a61c6867b98 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:23.499111 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06fa470a-010c-47e4-a117-4a61c6867b98 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:23.499853 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06fa470a-010c-47e4-a117-4a61c6867b98 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:23.500466 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06fa470a-010c-47e4-a117-4a61c6867b98 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:23.501322 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06fa470a-010c-47e4-a117-4a61c6867b98 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:23.502013 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06fa470a-010c-47e4-a117-4a61c6867b98 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:23.502441 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-06fa470a-010c-47e4-a117-4a61c6867b98 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:23.584067 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-06fa470a-010c-47e4-a117-4a61c6867b98 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:23.594343 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-06fa470a-010c-47e4-a117-4a61c6867b98 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1210 microversion: 2.1 time: 0.108330 Aug 08 14:38:23.595499 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 553/1152] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:23 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:38:24.616674 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d8437322-c270-47a3-8d52-65acac3c207e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:24.617282 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d8437322-c270-47a3-8d52-65acac3c207e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:24.620211 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:38:24.620866 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:38:24.627893 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d8437322-c270-47a3-8d52-65acac3c207e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:24.628312 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d8437322-c270-47a3-8d52-65acac3c207e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:24.629258 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d8437322-c270-47a3-8d52-65acac3c207e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:24.629981 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d8437322-c270-47a3-8d52-65acac3c207e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:24.630432 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d8437322-c270-47a3-8d52-65acac3c207e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:24.630859 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d8437322-c270-47a3-8d52-65acac3c207e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:24.868973 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d8437322-c270-47a3-8d52-65acac3c207e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:24.884626 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d8437322-c270-47a3-8d52-65acac3c207e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1264 microversion: 2.1 time: 0.270870 Aug 08 14:38:24.884626 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 600/1153] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:24 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1264 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:25.004779 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-e2d61de6-6dff-4911-9dc9-4a368924d029 req-a9c6de02-9e56-4fd8-9634-36e484eb77d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb071f46-f292-43de-9abd-e7efc9dd3616", "tag": "94bc8ac2-a326-4398-855d-d7aa05a32d8d"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:38:25.036227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-e2d61de6-6dff-4911-9dc9-4a368924d029 req-a9c6de02-9e56-4fd8-9634-36e484eb77d4 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:25.036780 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-e2d61de6-6dff-4911-9dc9-4a368924d029 req-a9c6de02-9e56-4fd8-9634-36e484eb77d4 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:25.037212 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-e2d61de6-6dff-4911-9dc9-4a368924d029 req-a9c6de02-9e56-4fd8-9634-36e484eb77d4 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:25.049666 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-e2d61de6-6dff-4911-9dc9-4a368924d029 req-a9c6de02-9e56-4fd8-9634-36e484eb77d4 service nova] Creating event network-changed:94bc8ac2-a326-4398-855d-d7aa05a32d8d for instance eb071f46-f292-43de-9abd-e7efc9dd3616 on hv-cinder-85200 Aug 08 14:38:25.055445 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-e2d61de6-6dff-4911-9dc9-4a368924d029 req-a9c6de02-9e56-4fd8-9634-36e484eb77d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055855 Aug 08 14:38:25.056052 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 554/1154] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:38:25.905695 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-493b9328-13c3-4c6a-b08a-2dedc8755ca8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:25.907371 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-493b9328-13c3-4c6a-b08a-2dedc8755ca8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:25.918428 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-493b9328-13c3-4c6a-b08a-2dedc8755ca8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:25.919483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-493b9328-13c3-4c6a-b08a-2dedc8755ca8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:25.920824 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-493b9328-13c3-4c6a-b08a-2dedc8755ca8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:25.922206 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-493b9328-13c3-4c6a-b08a-2dedc8755ca8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:25.922895 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-493b9328-13c3-4c6a-b08a-2dedc8755ca8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:25.923978 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-493b9328-13c3-4c6a-b08a-2dedc8755ca8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:26.142720 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-493b9328-13c3-4c6a-b08a-2dedc8755ca8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:26.150729 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-493b9328-13c3-4c6a-b08a-2dedc8755ca8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1264 microversion: 2.1 time: 0.249759 Aug 08 14:38:26.151328 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 601/1155] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:25 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1264 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:26.754304 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-af5bd4a2-f4ff-491d-b53f-919cd49ffabd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:26.754871 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-af5bd4a2-f4ff-491d-b53f-919cd49ffabd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:26.761413 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-af5bd4a2-f4ff-491d-b53f-919cd49ffabd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:26.761891 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-af5bd4a2-f4ff-491d-b53f-919cd49ffabd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:26.762323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-af5bd4a2-f4ff-491d-b53f-919cd49ffabd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:26.763007 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-af5bd4a2-f4ff-491d-b53f-919cd49ffabd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:26.763483 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-af5bd4a2-f4ff-491d-b53f-919cd49ffabd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:26.763905 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-af5bd4a2-f4ff-491d-b53f-919cd49ffabd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:26.785845 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-af5bd4a2-f4ff-491d-b53f-919cd49ffabd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072/ips" status: 200 len: 150 microversion: 2.1 time: 0.036181 Aug 08 14:38:26.786389 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 555/1156] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 14:38:26 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:38:27.172601 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-393020e8-e4a7-4c59-96fa-32d39bf1abc0 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:27.173418 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-393020e8-e4a7-4c59-96fa-32d39bf1abc0 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:27.180096 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-393020e8-e4a7-4c59-96fa-32d39bf1abc0 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:27.180581 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-393020e8-e4a7-4c59-96fa-32d39bf1abc0 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:27.181014 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-393020e8-e4a7-4c59-96fa-32d39bf1abc0 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:27.181706 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-393020e8-e4a7-4c59-96fa-32d39bf1abc0 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:27.182279 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-393020e8-e4a7-4c59-96fa-32d39bf1abc0 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:27.182697 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-393020e8-e4a7-4c59-96fa-32d39bf1abc0 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:27.319480 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-393020e8-e4a7-4c59-96fa-32d39bf1abc0 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:27.326887 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-393020e8-e4a7-4c59-96fa-32d39bf1abc0 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1264 microversion: 2.1 time: 0.159446 Aug 08 14:38:27.327487 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 602/1157] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:27 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:28.111909 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-040590a0-83bb-4ff7-9180-f3f3c5692bd3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0a16e43-e32f-42d7-898e-f50df258025e"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:38:28.114779 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-040590a0-83bb-4ff7-9180-f3f3c5692bd3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:28.121049 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-040590a0-83bb-4ff7-9180-f3f3c5692bd3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:28.121524 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-040590a0-83bb-4ff7-9180-f3f3c5692bd3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:28.121985 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-040590a0-83bb-4ff7-9180-f3f3c5692bd3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:28.122667 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-040590a0-83bb-4ff7-9180-f3f3c5692bd3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:28.123152 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-040590a0-83bb-4ff7-9180-f3f3c5692bd3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:28.123576 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-040590a0-83bb-4ff7-9180-f3f3c5692bd3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:28.348000 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2b70b0e5-c8bf-4277-abb9-9e24843c584b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:28.348615 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2b70b0e5-c8bf-4277-abb9-9e24843c584b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:28.354980 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b70b0e5-c8bf-4277-abb9-9e24843c584b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:28.355501 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b70b0e5-c8bf-4277-abb9-9e24843c584b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:28.355944 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b70b0e5-c8bf-4277-abb9-9e24843c584b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:28.356641 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b70b0e5-c8bf-4277-abb9-9e24843c584b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:28.357104 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b70b0e5-c8bf-4277-abb9-9e24843c584b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:28.357535 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2b70b0e5-c8bf-4277-abb9-9e24843c584b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:28.490112 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2b70b0e5-c8bf-4277-abb9-9e24843c584b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:28.497419 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2b70b0e5-c8bf-4277-abb9-9e24843c584b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1264 microversion: 2.1 time: 0.153292 Aug 08 14:38:28.497975 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 603/1158] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:28 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:38:29.517645 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7f9e0c67-867b-45f2-a66a-ddcd71771640 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:29.518283 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7f9e0c67-867b-45f2-a66a-ddcd71771640 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:29.524751 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f9e0c67-867b-45f2-a66a-ddcd71771640 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:29.525237 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f9e0c67-867b-45f2-a66a-ddcd71771640 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:29.525675 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f9e0c67-867b-45f2-a66a-ddcd71771640 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:29.526373 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f9e0c67-867b-45f2-a66a-ddcd71771640 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:29.526827 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f9e0c67-867b-45f2-a66a-ddcd71771640 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:29.527289 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7f9e0c67-867b-45f2-a66a-ddcd71771640 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:29.657543 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7f9e0c67-867b-45f2-a66a-ddcd71771640 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:29.665116 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7f9e0c67-867b-45f2-a66a-ddcd71771640 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1264 microversion: 2.1 time: 0.151424 Aug 08 14:38:29.665674 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 604/1159] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:29 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 14:38:30.318813 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-040590a0-83bb-4ff7-9180-f3f3c5692bd3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "POST /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.210753 Aug 08 14:38:30.319665 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 556/1160] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 14:38:28 2022] POST /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072/os-volume_attachments => generated 194 bytes in 2212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:38:30.685785 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-2fd5e4e4-f776-43e1-8358-e41c1c598db1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:30.686393 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-2fd5e4e4-f776-43e1-8358-e41c1c598db1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:30.693194 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fd5e4e4-f776-43e1-8358-e41c1c598db1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:30.693677 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fd5e4e4-f776-43e1-8358-e41c1c598db1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:30.694101 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fd5e4e4-f776-43e1-8358-e41c1c598db1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:30.694833 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fd5e4e4-f776-43e1-8358-e41c1c598db1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:30.695268 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fd5e4e4-f776-43e1-8358-e41c1c598db1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:30.695691 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-2fd5e4e4-f776-43e1-8358-e41c1c598db1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:30.830917 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-2fd5e4e4-f776-43e1-8358-e41c1c598db1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:30.839011 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-2fd5e4e4-f776-43e1-8358-e41c1c598db1 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1264 microversion: 2.1 time: 0.157078 Aug 08 14:38:30.839587 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 605/1161] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:30 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:31.859604 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-19fb1689-afd7-4d3f-9e7a-8e9ff261d493 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:31.861227 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-19fb1689-afd7-4d3f-9e7a-8e9ff261d493 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:31.864285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:38:31.869943 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-19fb1689-afd7-4d3f-9e7a-8e9ff261d493 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:31.870421 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-19fb1689-afd7-4d3f-9e7a-8e9ff261d493 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:31.870859 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-19fb1689-afd7-4d3f-9e7a-8e9ff261d493 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:31.871576 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-19fb1689-afd7-4d3f-9e7a-8e9ff261d493 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:31.872023 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-19fb1689-afd7-4d3f-9e7a-8e9ff261d493 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:31.872445 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-19fb1689-afd7-4d3f-9e7a-8e9ff261d493 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:32.003607 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-19fb1689-afd7-4d3f-9e7a-8e9ff261d493 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:32.010963 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-19fb1689-afd7-4d3f-9e7a-8e9ff261d493 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1264 microversion: 2.1 time: 0.156251 Aug 08 14:38:32.011582 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 557/1162] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:31 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:33.032371 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7a0a833c-65a7-4a6f-8163-2209f215c544 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:33.033519 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7a0a833c-65a7-4a6f-8163-2209f215c544 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:33.036866 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell0:SELECT=2 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:38:33.042529 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7a0a833c-65a7-4a6f-8163-2209f215c544 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:33.043035 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7a0a833c-65a7-4a6f-8163-2209f215c544 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:33.043660 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7a0a833c-65a7-4a6f-8163-2209f215c544 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:33.044549 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7a0a833c-65a7-4a6f-8163-2209f215c544 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:33.045142 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7a0a833c-65a7-4a6f-8163-2209f215c544 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:33.045600 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7a0a833c-65a7-4a6f-8163-2209f215c544 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:33.179824 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7a0a833c-65a7-4a6f-8163-2209f215c544 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:33.187475 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7a0a833c-65a7-4a6f-8163-2209f215c544 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1264 microversion: 2.1 time: 0.159536 Aug 08 14:38:33.188039 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 606/1163] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:33 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:34.209050 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e9f02074-9d32-4145-8cc7-ed423a5b143f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:34.209657 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e9f02074-9d32-4145-8cc7-ed423a5b143f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:34.211485 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:38:34.212178 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=6 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:38:34.218889 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e9f02074-9d32-4145-8cc7-ed423a5b143f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:34.219420 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e9f02074-9d32-4145-8cc7-ed423a5b143f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:34.219857 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e9f02074-9d32-4145-8cc7-ed423a5b143f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:34.220606 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e9f02074-9d32-4145-8cc7-ed423a5b143f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:34.220979 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e9f02074-9d32-4145-8cc7-ed423a5b143f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:34.221399 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e9f02074-9d32-4145-8cc7-ed423a5b143f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:34.224739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:38:34.370074 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e9f02074-9d32-4145-8cc7-ed423a5b143f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:34.379321 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e9f02074-9d32-4145-8cc7-ed423a5b143f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1264 microversion: 2.1 time: 0.174448 Aug 08 14:38:34.379898 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 558/1164] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:34 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:35.072585 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-f808aff5-14bd-4db9-8283-bd945cbaebb4 req-b6806ec1-8035-4891-941a-a32a49ed9fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb071f46-f292-43de-9abd-e7efc9dd3616", "name": "network-vif-plugged", "status": "completed", "tag": "94bc8ac2-a326-4398-855d-d7aa05a32d8d"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:38:35.083422 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-f808aff5-14bd-4db9-8283-bd945cbaebb4 req-b6806ec1-8035-4891-941a-a32a49ed9fae service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:35.084048 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-f808aff5-14bd-4db9-8283-bd945cbaebb4 req-b6806ec1-8035-4891-941a-a32a49ed9fae service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:35.084602 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-f808aff5-14bd-4db9-8283-bd945cbaebb4 req-b6806ec1-8035-4891-941a-a32a49ed9fae service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:35.096482 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-f808aff5-14bd-4db9-8283-bd945cbaebb4 req-b6806ec1-8035-4891-941a-a32a49ed9fae service nova] Creating event network-vif-plugged:94bc8ac2-a326-4398-855d-d7aa05a32d8d for instance eb071f46-f292-43de-9abd-e7efc9dd3616 on hv-cinder-85200 Aug 08 14:38:35.102263 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-f808aff5-14bd-4db9-8283-bd945cbaebb4 req-b6806ec1-8035-4891-941a-a32a49ed9fae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033411 Aug 08 14:38:35.102976 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 607/1165] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:38:35.400600 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7c744845-13d9-49ec-8558-a658239dd54d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:35.401320 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7c744845-13d9-49ec-8558-a658239dd54d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:35.407778 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c744845-13d9-49ec-8558-a658239dd54d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:35.408266 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c744845-13d9-49ec-8558-a658239dd54d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:35.408704 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c744845-13d9-49ec-8558-a658239dd54d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:35.409610 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c744845-13d9-49ec-8558-a658239dd54d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:35.410067 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c744845-13d9-49ec-8558-a658239dd54d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:35.410749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c744845-13d9-49ec-8558-a658239dd54d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:35.546210 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7c744845-13d9-49ec-8558-a658239dd54d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:35.554560 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7c744845-13d9-49ec-8558-a658239dd54d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1264 microversion: 2.1 time: 0.157836 Aug 08 14:38:35.555773 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 559/1166] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:35 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:36.575927 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f879dad4-3c66-48bc-a3aa-85029a852623 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:36.576629 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f879dad4-3c66-48bc-a3aa-85029a852623 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:36.583283 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f879dad4-3c66-48bc-a3aa-85029a852623 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:36.583770 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f879dad4-3c66-48bc-a3aa-85029a852623 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:36.584210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f879dad4-3c66-48bc-a3aa-85029a852623 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:36.585711 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f879dad4-3c66-48bc-a3aa-85029a852623 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:36.585711 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f879dad4-3c66-48bc-a3aa-85029a852623 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:36.585908 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f879dad4-3c66-48bc-a3aa-85029a852623 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:36.731927 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f879dad4-3c66-48bc-a3aa-85029a852623 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:36.740335 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f879dad4-3c66-48bc-a3aa-85029a852623 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1264 microversion: 2.1 time: 0.169070 Aug 08 14:38:36.740989 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 608/1167] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:36 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:37.760699 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d21a7f2a-6bd6-457e-98f6-ae23c79f007e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:37.761345 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d21a7f2a-6bd6-457e-98f6-ae23c79f007e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:37.770777 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d21a7f2a-6bd6-457e-98f6-ae23c79f007e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:37.771313 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d21a7f2a-6bd6-457e-98f6-ae23c79f007e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:37.771756 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d21a7f2a-6bd6-457e-98f6-ae23c79f007e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:37.773552 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d21a7f2a-6bd6-457e-98f6-ae23c79f007e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:37.774245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d21a7f2a-6bd6-457e-98f6-ae23c79f007e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:37.774683 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d21a7f2a-6bd6-457e-98f6-ae23c79f007e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:37.928970 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d21a7f2a-6bd6-457e-98f6-ae23c79f007e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:37.937426 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d21a7f2a-6bd6-457e-98f6-ae23c79f007e tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1451 microversion: 2.1 time: 0.180542 Aug 08 14:38:37.937998 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 560/1168] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:37 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1451 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:37.958083 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ce680e2d-1927-47d0-9267-a86f05f27da6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:37.958704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ce680e2d-1927-47d0-9267-a86f05f27da6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:37.965244 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce680e2d-1927-47d0-9267-a86f05f27da6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:37.965730 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce680e2d-1927-47d0-9267-a86f05f27da6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:37.966174 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce680e2d-1927-47d0-9267-a86f05f27da6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:37.966874 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce680e2d-1927-47d0-9267-a86f05f27da6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:37.967368 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce680e2d-1927-47d0-9267-a86f05f27da6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:37.967802 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ce680e2d-1927-47d0-9267-a86f05f27da6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:38.104709 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ce680e2d-1927-47d0-9267-a86f05f27da6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:38.117735 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ce680e2d-1927-47d0-9267-a86f05f27da6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1451 microversion: 2.1 time: 0.163993 Aug 08 14:38:38.118359 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 609/1169] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:37 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:39.033554 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-af6e3012-0600-44e3-8ac6-533ce0209fcd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:39.034244 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-af6e3012-0600-44e3-8ac6-533ce0209fcd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:39.041237 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-af6e3012-0600-44e3-8ac6-533ce0209fcd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:39.041715 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-af6e3012-0600-44e3-8ac6-533ce0209fcd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:39.042148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-af6e3012-0600-44e3-8ac6-533ce0209fcd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:39.042848 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-af6e3012-0600-44e3-8ac6-533ce0209fcd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:39.043311 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-af6e3012-0600-44e3-8ac6-533ce0209fcd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:39.043727 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-af6e3012-0600-44e3-8ac6-533ce0209fcd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:39.128948 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-af6e3012-0600-44e3-8ac6-533ce0209fcd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lazy-loading 'services' on Instance uuid 4d8f2558-dee3-46cc-84ef-d11a1133d072 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:38:39.210002 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-af6e3012-0600-44e3-8ac6-533ce0209fcd tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072/os-volume_attachments/d0a16e43-e32f-42d7-898e-f50df258025e" status: 202 len: 0 microversion: 2.1 time: 0.181229 Aug 08 14:38:39.210884 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 561/1170] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 14:38:39 2022] DELETE /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072/os-volume_attachments/d0a16e43-e32f-42d7-898e-f50df258025e => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:38:39.219475 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-cbdfe6fd-ff91-4742-a8ee-755a8589ba3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:39.221647 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-cbdfe6fd-ff91-4742-a8ee-755a8589ba3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:39.229141 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cbdfe6fd-ff91-4742-a8ee-755a8589ba3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:39.229628 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cbdfe6fd-ff91-4742-a8ee-755a8589ba3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:39.230248 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cbdfe6fd-ff91-4742-a8ee-755a8589ba3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:39.230952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cbdfe6fd-ff91-4742-a8ee-755a8589ba3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:39.231617 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cbdfe6fd-ff91-4742-a8ee-755a8589ba3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:39.232041 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-cbdfe6fd-ff91-4742-a8ee-755a8589ba3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:39.266366 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-cbdfe6fd-ff91-4742-a8ee-755a8589ba3b tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050850 Aug 08 14:38:39.267005 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 610/1171] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:38:39 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:38:40.061525 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-4eae00e8-e4df-4f6e-ac43-bb63009fb682 req-a9754427-3b2e-4458-972b-4d904e5b4f6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb071f46-f292-43de-9abd-e7efc9dd3616", "tag": "94bc8ac2-a326-4398-855d-d7aa05a32d8d"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:38:40.077497 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-4eae00e8-e4df-4f6e-ac43-bb63009fb682 req-a9754427-3b2e-4458-972b-4d904e5b4f6f service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:40.078108 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-4eae00e8-e4df-4f6e-ac43-bb63009fb682 req-a9754427-3b2e-4458-972b-4d904e5b4f6f service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:40.078584 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-4eae00e8-e4df-4f6e-ac43-bb63009fb682 req-a9754427-3b2e-4458-972b-4d904e5b4f6f service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:40.095553 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-4eae00e8-e4df-4f6e-ac43-bb63009fb682 req-a9754427-3b2e-4458-972b-4d904e5b4f6f service nova] Creating event network-changed:94bc8ac2-a326-4398-855d-d7aa05a32d8d for instance eb071f46-f292-43de-9abd-e7efc9dd3616 on hv-cinder-85200 Aug 08 14:38:40.102883 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-4eae00e8-e4df-4f6e-ac43-bb63009fb682 req-a9754427-3b2e-4458-972b-4d904e5b4f6f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045907 Aug 08 14:38:40.103500 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 562/1172] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:38:40.282281 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-9aacbf07-21f7-4531-a1b8-05c68ba28be0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:40.284806 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-9aacbf07-21f7-4531-a1b8-05c68ba28be0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:40.292004 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9aacbf07-21f7-4531-a1b8-05c68ba28be0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:40.292917 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9aacbf07-21f7-4531-a1b8-05c68ba28be0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:40.293614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9aacbf07-21f7-4531-a1b8-05c68ba28be0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:40.294597 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9aacbf07-21f7-4531-a1b8-05c68ba28be0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:40.295292 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9aacbf07-21f7-4531-a1b8-05c68ba28be0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:40.296070 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-9aacbf07-21f7-4531-a1b8-05c68ba28be0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:40.330218 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-9aacbf07-21f7-4531-a1b8-05c68ba28be0 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054827 Aug 08 14:38:40.331345 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 611/1173] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 14:38:40 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 14:38:40.401045 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d87bb173-4955-4e1a-87db-0755eaabfe17 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:40.401632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d87bb173-4955-4e1a-87db-0755eaabfe17 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:40.408050 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d87bb173-4955-4e1a-87db-0755eaabfe17 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:40.408538 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d87bb173-4955-4e1a-87db-0755eaabfe17 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:40.408968 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d87bb173-4955-4e1a-87db-0755eaabfe17 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:40.410646 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d87bb173-4955-4e1a-87db-0755eaabfe17 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:40.411305 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d87bb173-4955-4e1a-87db-0755eaabfe17 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:40.411913 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d87bb173-4955-4e1a-87db-0755eaabfe17 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:40.460485 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d87bb173-4955-4e1a-87db-0755eaabfe17 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:38:40.565411 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d87bb173-4955-4e1a-87db-0755eaabfe17 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 204 len: 0 microversion: 2.1 time: 0.168136 Aug 08 14:38:40.566176 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 563/1174] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:38:40 2022] DELETE /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:38:40.574320 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-27ad849f-7cfa-4b32-acfb-b9e19bed70ae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:40.575193 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-27ad849f-7cfa-4b32-acfb-b9e19bed70ae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:40.581696 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-27ad849f-7cfa-4b32-acfb-b9e19bed70ae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:40.582181 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-27ad849f-7cfa-4b32-acfb-b9e19bed70ae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:40.582615 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-27ad849f-7cfa-4b32-acfb-b9e19bed70ae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:40.583380 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-27ad849f-7cfa-4b32-acfb-b9e19bed70ae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:40.584710 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-27ad849f-7cfa-4b32-acfb-b9e19bed70ae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:40.585642 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-27ad849f-7cfa-4b32-acfb-b9e19bed70ae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:40.729987 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-27ad849f-7cfa-4b32-acfb-b9e19bed70ae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:40.738494 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-27ad849f-7cfa-4b32-acfb-b9e19bed70ae tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1682 microversion: 2.1 time: 0.167456 Aug 08 14:38:40.739748 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 612/1175] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:40 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:41.760550 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-266cce11-9e2e-40fd-ba7e-0a633cd6f8ef tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:41.761158 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-266cce11-9e2e-40fd-ba7e-0a633cd6f8ef tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:41.767786 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-266cce11-9e2e-40fd-ba7e-0a633cd6f8ef tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:41.768275 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-266cce11-9e2e-40fd-ba7e-0a633cd6f8ef tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:41.768894 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-266cce11-9e2e-40fd-ba7e-0a633cd6f8ef tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:41.769581 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-266cce11-9e2e-40fd-ba7e-0a633cd6f8ef tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:41.770031 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-266cce11-9e2e-40fd-ba7e-0a633cd6f8ef tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:41.770819 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-266cce11-9e2e-40fd-ba7e-0a633cd6f8ef tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:41.908848 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-266cce11-9e2e-40fd-ba7e-0a633cd6f8ef tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:41.918323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-266cce11-9e2e-40fd-ba7e-0a633cd6f8ef tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1682 microversion: 2.1 time: 0.161977 Aug 08 14:38:41.918991 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 564/1176] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:41 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:42.939876 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-b5cef330-1de7-455e-b4c3-ce9056064335 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:42.940583 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-b5cef330-1de7-455e-b4c3-ce9056064335 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:42.947499 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b5cef330-1de7-455e-b4c3-ce9056064335 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:42.947982 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b5cef330-1de7-455e-b4c3-ce9056064335 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:42.948429 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b5cef330-1de7-455e-b4c3-ce9056064335 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:42.949122 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b5cef330-1de7-455e-b4c3-ce9056064335 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:42.949588 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b5cef330-1de7-455e-b4c3-ce9056064335 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:42.950013 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-b5cef330-1de7-455e-b4c3-ce9056064335 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:43.191906 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-b5cef330-1de7-455e-b4c3-ce9056064335 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a91f6797cc4604ba2606e0549234d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc86120e53145328dd430f542e73182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:43.200019 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-b5cef330-1de7-455e-b4c3-ce9056064335 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 200 len: 1682 microversion: 2.1 time: 0.264047 Aug 08 14:38:43.200578 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 613/1177] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:42 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 1682 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:43.425818 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-727c5c2c-133c-44a6-8f7f-b939a526a0ff req-6e8acb41-a558-4c83-905c-745c4a8dd117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d8f2558-dee3-46cc-84ef-d11a1133d072", "name": "network-vif-deleted", "tag": "935343b7-c1e4-41fe-8066-0a6e99a7578d"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:38:43.436723 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-727c5c2c-133c-44a6-8f7f-b939a526a0ff req-6e8acb41-a558-4c83-905c-745c4a8dd117 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:43.437203 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-727c5c2c-133c-44a6-8f7f-b939a526a0ff req-6e8acb41-a558-4c83-905c-745c4a8dd117 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:43.437819 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-727c5c2c-133c-44a6-8f7f-b939a526a0ff req-6e8acb41-a558-4c83-905c-745c4a8dd117 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:43.449244 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-727c5c2c-133c-44a6-8f7f-b939a526a0ff req-6e8acb41-a558-4c83-905c-745c4a8dd117 service nova] Creating event network-vif-deleted:935343b7-c1e4-41fe-8066-0a6e99a7578d for instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 on hv-cinder-85200 Aug 08 14:38:43.457006 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-727c5c2c-133c-44a6-8f7f-b939a526a0ff req-6e8acb41-a558-4c83-905c-745c4a8dd117 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035295 Aug 08 14:38:43.459416 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 565/1178] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:38:44.221446 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a599153e-bb0a-4057-9aa8-c82256ae2caf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:44.222080 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-a599153e-bb0a-4057-9aa8-c82256ae2caf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:44.228422 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a599153e-bb0a-4057-9aa8-c82256ae2caf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:44.228960 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a599153e-bb0a-4057-9aa8-c82256ae2caf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:44.229468 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a599153e-bb0a-4057-9aa8-c82256ae2caf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:44.230165 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a599153e-bb0a-4057-9aa8-c82256ae2caf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:44.230619 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a599153e-bb0a-4057-9aa8-c82256ae2caf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:44.231291 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-a599153e-bb0a-4057-9aa8-c82256ae2caf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:44.245810 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-a599153e-bb0a-4057-9aa8-c82256ae2caf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] HTTP exception thrown: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a599153e-bb0a-4057-9aa8-c82256ae2caf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Request method failure captured: Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 HTTP/1.1 Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4nDHzBnzio2VZ6ciHSRMNEEHFIYRjyMTvKRDfIH2F_niI0FcU0ZqBeBBZkKpUdHOb90TorX284g0qMdisJyL77Y3j06R-x49-mqWZufa0BFWwlg29tIQoalg1p609ZLEly-KDP4mLoxCO4eWlqZVpPuU5-IPf0H50niq4AklVZ208 Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:38:44.247704 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:38:44.249400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc86120e53145328dd430f542e73182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc86120e53145328dd430f542e73182", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}] Aug 08 14:38:44.249400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:44.249400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:44.249400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:44.249400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:44.249400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:38:44.249400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:38:44.249400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 48a91f6797cc4604ba2606e0549234d0 Aug 08 14:38:44.249400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:44.249400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:38:44.249400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:44.249400 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': '4d8f2558-dee3-46cc-84ef-d11a1133d072'} Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:44.250362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:44.251952 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:44.253622 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a599153e-bb0a-4057-9aa8-c82256ae2caf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Returning 404 to user: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:44.253622 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-a599153e-bb0a-4057-9aa8-c82256ae2caf tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 404 len: 111 microversion: 2.1 time: 0.031597 Aug 08 14:38:44.253622 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 614/1179] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:44 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:44.259636 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3f25567d-ff87-4fe0-a2c1-a6ddb844f7bc tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '.version_select at 0x7f9cb2552dc0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:44.279774 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3f25567d-ff87-4fe0-a2c1-a6ddb844f7bc tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227137178" status: 202 len: 0 microversion: 2.1 time: 0.025107 Aug 08 14:38:44.280745 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 566/1180] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Aug 8 14:38:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227137178 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:38:46.300101 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-daba0a2f-10c0-4618-916f-d6f4e86d66aa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:46.300742 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-daba0a2f-10c0-4618-916f-d6f4e86d66aa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:46.307628 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-daba0a2f-10c0-4618-916f-d6f4e86d66aa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:46.308109 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-daba0a2f-10c0-4618-916f-d6f4e86d66aa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:46.308545 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-daba0a2f-10c0-4618-916f-d6f4e86d66aa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:46.309241 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-daba0a2f-10c0-4618-916f-d6f4e86d66aa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:46.309694 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-daba0a2f-10c0-4618-916f-d6f4e86d66aa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:46.310120 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-daba0a2f-10c0-4618-916f-d6f4e86d66aa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:46.323592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-daba0a2f-10c0-4618-916f-d6f4e86d66aa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] HTTP exception thrown: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-daba0a2f-10c0-4618-916f-d6f4e86d66aa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Request method failure captured: Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: DELETE /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 HTTP/1.1 Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4nDHzBnzio2VZ6ciHSRMNEEHFIYRjyMTvKRDfIH2F_niI0FcU0ZqBeBBZkKpUdHOb90TorX284g0qMdisJyL77Y3j06R-x49-mqWZufa0BFWwlg29tIQoalg1p609ZLEly-KDP4mLoxCO4eWlqZVpPuU5-IPf0H50niq4AklVZ208 Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:38:46.325170 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:38:46.326769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc86120e53145328dd430f542e73182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc86120e53145328dd430f542e73182", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}] Aug 08 14:38:46.326769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:46.326769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:46.326769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:46.326769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:46.326769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:38:46.326769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:38:46.326769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 48a91f6797cc4604ba2606e0549234d0 Aug 08 14:38:46.326769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:46.326769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:38:46.326769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:46.326769 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': '4d8f2558-dee3-46cc-84ef-d11a1133d072'} Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:46.327593 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:46.328818 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:46.330396 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-daba0a2f-10c0-4618-916f-d6f4e86d66aa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Returning 404 to user: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:46.330396 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-daba0a2f-10c0-4618-916f-d6f4e86d66aa tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 404 len: 111 microversion: 2.1 time: 0.030316 Aug 08 14:38:46.330396 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 615/1181] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:38:46 2022] DELETE /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 14:38:46.338784 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-19736e4a-d54c-4e9d-b3ac-4ab083d4e4a5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:46.339894 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-19736e4a-d54c-4e9d-b3ac-4ab083d4e4a5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 4d8f2558-dee3-46cc-84ef-d11a1133d072] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:46.347454 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-19736e4a-d54c-4e9d-b3ac-4ab083d4e4a5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:46.347943 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-19736e4a-d54c-4e9d-b3ac-4ab083d4e4a5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:46.348408 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-19736e4a-d54c-4e9d-b3ac-4ab083d4e4a5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:46.349116 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-19736e4a-d54c-4e9d-b3ac-4ab083d4e4a5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:46.349572 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-19736e4a-d54c-4e9d-b3ac-4ab083d4e4a5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:46.350022 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-19736e4a-d54c-4e9d-b3ac-4ab083d4e4a5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:46.363664 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-19736e4a-d54c-4e9d-b3ac-4ab083d4e4a5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] HTTP exception thrown: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-19736e4a-d54c-4e9d-b3ac-4ab083d4e4a5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Request method failure captured: Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 HTTP/1.1 Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4nDHzBnzio2VZ6ciHSRMNEEHFIYRjyMTvKRDfIH2F_niI0FcU0ZqBeBBZkKpUdHOb90TorX284g0qMdisJyL77Y3j06R-x49-mqWZufa0BFWwlg29tIQoalg1p609ZLEly-KDP4mLoxCO4eWlqZVpPuU5-IPf0H50niq4AklVZ208 Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:38:46.365285 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:38:46.366900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc86120e53145328dd430f542e73182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc86120e53145328dd430f542e73182", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}] Aug 08 14:38:46.366900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:46.366900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:46.366900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:46.366900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:46.366900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:38:46.366900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:38:46.366900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 48a91f6797cc4604ba2606e0549234d0 Aug 08 14:38:46.366900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:46.366900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:38:46.366900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:46.366900 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '4d8f2558-dee3-46cc-84ef-d11a1133d072'} Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:46.368323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. Aug 08 14:38:46.369577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:46.370673 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-19736e4a-d54c-4e9d-b3ac-4ab083d4e4a5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Returning 404 to user: Instance 4d8f2558-dee3-46cc-84ef-d11a1133d072 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:46.370673 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-19736e4a-d54c-4e9d-b3ac-4ab083d4e4a5 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072" status: 404 len: 111 microversion: 2.1 time: 0.032315 Aug 08 14:38:46.370673 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 567/1182] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:46 2022] GET /compute/v2.1/servers/4d8f2558-dee3-46cc-84ef-d11a1133d072 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:47.511378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-34aa34c5-4fc7-4946-9110-066f0500ba47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:47.511378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-34aa34c5-4fc7-4946-9110-066f0500ba47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:47.514434 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-34aa34c5-4fc7-4946-9110-066f0500ba47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:47.514913 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-34aa34c5-4fc7-4946-9110-066f0500ba47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:47.515373 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-34aa34c5-4fc7-4946-9110-066f0500ba47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:47.516072 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-34aa34c5-4fc7-4946-9110-066f0500ba47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:47.516523 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-34aa34c5-4fc7-4946-9110-066f0500ba47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:47.516944 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-34aa34c5-4fc7-4946-9110-066f0500ba47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:47.531006 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-34aa34c5-4fc7-4946-9110-066f0500ba47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] HTTP exception thrown: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-34aa34c5-4fc7-4946-9110-066f0500ba47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Request method failure captured: Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: DELETE /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 HTTP/1.1 Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4nDHzBnzio2VZ6ciHSRMNEEHFIYRjyMTvKRDfIH2F_niI0FcU0ZqBeBBZkKpUdHOb90TorX284g0qMdisJyL77Y3j06R-x49-mqWZufa0BFWwlg29tIQoalg1p609ZLEly-KDP4mLoxCO4eWlqZVpPuU5-IPf0H50niq4AklVZ208 Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:38:47.532591 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:38:47.534150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc86120e53145328dd430f542e73182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc86120e53145328dd430f542e73182", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}] Aug 08 14:38:47.534150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:47.534150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:47.534150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:47.534150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:47.534150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:38:47.534150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:38:47.534150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 48a91f6797cc4604ba2606e0549234d0 Aug 08 14:38:47.534150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:47.534150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:38:47.534150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:38:47.534150 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': 'ba51345a-39b0-42ed-b0af-bff1e07fd698'} Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:47.535323 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:38:47.536778 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.538241 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-34aa34c5-4fc7-4946-9110-066f0500ba47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Returning 404 to user: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:47.538241 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-34aa34c5-4fc7-4946-9110-066f0500ba47 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 404 len: 111 microversion: 2.1 time: 0.031717 Aug 08 14:38:47.538241 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 616/1183] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:38:47 2022] DELETE /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:47.542972 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-569cc516-e69a-4f25-941c-e447b0814651 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:47.543660 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-569cc516-e69a-4f25-941c-e447b0814651 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: ba51345a-39b0-42ed-b0af-bff1e07fd698] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:47.550280 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-569cc516-e69a-4f25-941c-e447b0814651 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:47.550769 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-569cc516-e69a-4f25-941c-e447b0814651 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:47.551239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-569cc516-e69a-4f25-941c-e447b0814651 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:47.551948 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-569cc516-e69a-4f25-941c-e447b0814651 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:47.552409 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-569cc516-e69a-4f25-941c-e447b0814651 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:47.552834 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-569cc516-e69a-4f25-941c-e447b0814651 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:47.566689 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-569cc516-e69a-4f25-941c-e447b0814651 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] HTTP exception thrown: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-569cc516-e69a-4f25-941c-e447b0814651 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Request method failure captured: Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 HTTP/1.1 Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4nDHzBnzio2VZ6ciHSRMNEEHFIYRjyMTvKRDfIH2F_niI0FcU0ZqBeBBZkKpUdHOb90TorX284g0qMdisJyL77Y3j06R-x49-mqWZufa0BFWwlg29tIQoalg1p609ZLEly-KDP4mLoxCO4eWlqZVpPuU5-IPf0H50niq4AklVZ208 Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:38:47.568303 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:38:47.569937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc86120e53145328dd430f542e73182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc86120e53145328dd430f542e73182", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}] Aug 08 14:38:47.569937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:47.569937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:47.569937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:47.569937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:47.569937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:38:47.569937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:38:47.569937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 48a91f6797cc4604ba2606e0549234d0 Aug 08 14:38:47.569937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:47.569937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:38:47.569937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:38:47.569937 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'ba51345a-39b0-42ed-b0af-bff1e07fd698'} Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:47.571372 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. Aug 08 14:38:47.572597 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.573666 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-569cc516-e69a-4f25-941c-e447b0814651 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Returning 404 to user: Instance ba51345a-39b0-42ed-b0af-bff1e07fd698 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:47.573666 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-569cc516-e69a-4f25-941c-e447b0814651 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698" status: 404 len: 111 microversion: 2.1 time: 0.030800 Aug 08 14:38:47.573666 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 568/1184] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:47 2022] GET /compute/v2.1/servers/ba51345a-39b0-42ed-b0af-bff1e07fd698 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:47.578631 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-31d2309a-0205-4e1b-b40f-a61e8ba9d249 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:47.579145 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-31d2309a-0205-4e1b-b40f-a61e8ba9d249 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:47.585599 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-31d2309a-0205-4e1b-b40f-a61e8ba9d249 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:47.586235 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-31d2309a-0205-4e1b-b40f-a61e8ba9d249 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:47.586806 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-31d2309a-0205-4e1b-b40f-a61e8ba9d249 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:47.587635 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-31d2309a-0205-4e1b-b40f-a61e8ba9d249 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:47.588201 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-31d2309a-0205-4e1b-b40f-a61e8ba9d249 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:47.588753 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-31d2309a-0205-4e1b-b40f-a61e8ba9d249 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:47.602870 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-31d2309a-0205-4e1b-b40f-a61e8ba9d249 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] HTTP exception thrown: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-31d2309a-0205-4e1b-b40f-a61e8ba9d249 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Request method failure captured: Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: DELETE /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 HTTP/1.1 Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4nDHzBnzio2VZ6ciHSRMNEEHFIYRjyMTvKRDfIH2F_niI0FcU0ZqBeBBZkKpUdHOb90TorX284g0qMdisJyL77Y3j06R-x49-mqWZufa0BFWwlg29tIQoalg1p609ZLEly-KDP4mLoxCO4eWlqZVpPuU5-IPf0H50niq4AklVZ208 Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:38:47.604701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:38:47.606023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc86120e53145328dd430f542e73182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc86120e53145328dd430f542e73182", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}] Aug 08 14:38:47.606023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:47.606023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:47.606023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:47.606023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:47.606023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:38:47.606023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:38:47.606023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 48a91f6797cc4604ba2606e0549234d0 Aug 08 14:38:47.606023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:47.606023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:38:47.606023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:38:47.606023 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': 'c19ca8ed-1d03-4d63-9e99-900018554325'} Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:47.606747 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:38:47.608030 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.609783 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-31d2309a-0205-4e1b-b40f-a61e8ba9d249 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Returning 404 to user: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:47.609783 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-31d2309a-0205-4e1b-b40f-a61e8ba9d249 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 404 len: 111 microversion: 2.1 time: 0.031260 Aug 08 14:38:47.609783 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 617/1185] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:38:47 2022] DELETE /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:47.614681 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5b31b2d1-27e6-496f-8b0a-303b42630d13 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:47.615317 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5b31b2d1-27e6-496f-8b0a-303b42630d13 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: c19ca8ed-1d03-4d63-9e99-900018554325] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:47.621723 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b31b2d1-27e6-496f-8b0a-303b42630d13 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:47.622199 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b31b2d1-27e6-496f-8b0a-303b42630d13 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:47.622635 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b31b2d1-27e6-496f-8b0a-303b42630d13 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:47.623351 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b31b2d1-27e6-496f-8b0a-303b42630d13 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:47.623826 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b31b2d1-27e6-496f-8b0a-303b42630d13 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:47.624245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b31b2d1-27e6-496f-8b0a-303b42630d13 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:47.642929 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-5b31b2d1-27e6-496f-8b0a-303b42630d13 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] HTTP exception thrown: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5b31b2d1-27e6-496f-8b0a-303b42630d13 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Request method failure captured: Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 HTTP/1.1 Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4nDHzBnzio2VZ6ciHSRMNEEHFIYRjyMTvKRDfIH2F_niI0FcU0ZqBeBBZkKpUdHOb90TorX284g0qMdisJyL77Y3j06R-x49-mqWZufa0BFWwlg29tIQoalg1p609ZLEly-KDP4mLoxCO4eWlqZVpPuU5-IPf0H50niq4AklVZ208 Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:38:47.644601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:38:47.646239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc86120e53145328dd430f542e73182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc86120e53145328dd430f542e73182", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}] Aug 08 14:38:47.646239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:47.646239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:47.646239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:47.646239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:47.646239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:38:47.646239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:38:47.646239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 48a91f6797cc4604ba2606e0549234d0 Aug 08 14:38:47.646239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:47.646239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:38:47.646239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:38:47.646239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'c19ca8ed-1d03-4d63-9e99-900018554325'} Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:47.647567 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. Aug 08 14:38:47.649338 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:47.650697 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5b31b2d1-27e6-496f-8b0a-303b42630d13 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Returning 404 to user: Instance c19ca8ed-1d03-4d63-9e99-900018554325 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:47.650697 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5b31b2d1-27e6-496f-8b0a-303b42630d13 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325" status: 404 len: 111 microversion: 2.1 time: 0.035426 Aug 08 14:38:47.650697 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 569/1186] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:47 2022] GET /compute/v2.1/servers/c19ca8ed-1d03-4d63-9e99-900018554325 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:47.667372 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-c9d8349f-7f8b-4064-a6e5-813094874d62 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:47.669539 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-c9d8349f-7f8b-4064-a6e5-813094874d62 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:47.675481 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9d8349f-7f8b-4064-a6e5-813094874d62 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:47.675959 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9d8349f-7f8b-4064-a6e5-813094874d62 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:47.676392 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9d8349f-7f8b-4064-a6e5-813094874d62 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:47.677085 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9d8349f-7f8b-4064-a6e5-813094874d62 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:47.677536 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9d8349f-7f8b-4064-a6e5-813094874d62 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:47.677957 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-c9d8349f-7f8b-4064-a6e5-813094874d62 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:47.713063 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-c9d8349f-7f8b-4064-a6e5-813094874d62 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050226 Aug 08 14:38:47.713647 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 618/1187] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Aug 8 14:38:47 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:38:47.777557 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7210695c-94b2-4883-885c-cd935cf887b9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:47.778051 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7210695c-94b2-4883-885c-cd935cf887b9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:47.783962 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7210695c-94b2-4883-885c-cd935cf887b9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:47.784552 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7210695c-94b2-4883-885c-cd935cf887b9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:47.785254 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7210695c-94b2-4883-885c-cd935cf887b9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:47.785947 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7210695c-94b2-4883-885c-cd935cf887b9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:47.786407 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7210695c-94b2-4883-885c-cd935cf887b9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:47.786835 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7210695c-94b2-4883-885c-cd935cf887b9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:47.813569 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7210695c-94b2-4883-885c-cd935cf887b9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:38:47.888319 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7210695c-94b2-4883-885c-cd935cf887b9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 204 len: 0 microversion: 2.20 time: 0.114425 Aug 08 14:38:47.888898 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 570/1188] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Aug 8 14:38:47 2022] DELETE /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 14:38:47.897248 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1edd20db-2854-41ec-a1df-df439976c87a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:47.897932 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1edd20db-2854-41ec-a1df-df439976c87a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:47.903787 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1edd20db-2854-41ec-a1df-df439976c87a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:47.904270 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1edd20db-2854-41ec-a1df-df439976c87a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:47.904706 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1edd20db-2854-41ec-a1df-df439976c87a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:47.905397 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1edd20db-2854-41ec-a1df-df439976c87a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:47.905918 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1edd20db-2854-41ec-a1df-df439976c87a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:47.906348 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1edd20db-2854-41ec-a1df-df439976c87a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:48.042469 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-1edd20db-2854-41ec-a1df-df439976c87a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:48.046007 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=100 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:38:48.052082 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-1edd20db-2854-41ec-a1df-df439976c87a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:48.053638 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-1edd20db-2854-41ec-a1df-df439976c87a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:48.055484 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1edd20db-2854-41ec-a1df-df439976c87a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.161587 Aug 08 14:38:48.056045 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 619/1189] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:38:47 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 14:38:48.792178 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9ea336bd-f909-46cb-a21e-52b03b3e88d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:48.792766 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9ea336bd-f909-46cb-a21e-52b03b3e88d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:48.799017 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9ea336bd-f909-46cb-a21e-52b03b3e88d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:48.799535 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9ea336bd-f909-46cb-a21e-52b03b3e88d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:48.799974 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9ea336bd-f909-46cb-a21e-52b03b3e88d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:48.800759 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9ea336bd-f909-46cb-a21e-52b03b3e88d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:48.801133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9ea336bd-f909-46cb-a21e-52b03b3e88d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:48.801563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9ea336bd-f909-46cb-a21e-52b03b3e88d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:48.815260 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-9ea336bd-f909-46cb-a21e-52b03b3e88d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] HTTP exception thrown: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9ea336bd-f909-46cb-a21e-52b03b3e88d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Request method failure captured: Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: DELETE /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 HTTP/1.1 Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4nDHzBnzio2VZ6ciHSRMNEEHFIYRjyMTvKRDfIH2F_niI0FcU0ZqBeBBZkKpUdHOb90TorX284g0qMdisJyL77Y3j06R-x49-mqWZufa0BFWwlg29tIQoalg1p609ZLEly-KDP4mLoxCO4eWlqZVpPuU5-IPf0H50niq4AklVZ208 Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:38:48.816980 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:38:48.818674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc86120e53145328dd430f542e73182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc86120e53145328dd430f542e73182", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}] Aug 08 14:38:48.818674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:48.818674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:48.818674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:48.818674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:48.818674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:38:48.818674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:38:48.818674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 48a91f6797cc4604ba2606e0549234d0 Aug 08 14:38:48.818674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:48.818674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:38:48.818674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:38:48.818674 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70'} Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:48.819632 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:38:48.821563 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:48.823009 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9ea336bd-f909-46cb-a21e-52b03b3e88d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Returning 404 to user: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:48.823009 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9ea336bd-f909-46cb-a21e-52b03b3e88d3 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 404 len: 111 microversion: 2.1 time: 0.030727 Aug 08 14:38:48.823009 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 571/1190] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:38:48 2022] DELETE /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:48.827366 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bbf5807d-b031-4159-a313-5834f01fb171 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:48.827981 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-bbf5807d-b031-4159-a313-5834f01fb171 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] [instance: 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:48.834643 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bbf5807d-b031-4159-a313-5834f01fb171 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:48.835169 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bbf5807d-b031-4159-a313-5834f01fb171 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:48.835614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bbf5807d-b031-4159-a313-5834f01fb171 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:48.836990 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bbf5807d-b031-4159-a313-5834f01fb171 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:48.837452 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bbf5807d-b031-4159-a313-5834f01fb171 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:48.837885 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-bbf5807d-b031-4159-a313-5834f01fb171 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:48.852184 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-bbf5807d-b031-4159-a313-5834f01fb171 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] HTTP exception thrown: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bbf5807d-b031-4159-a313-5834f01fb171 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Request method failure captured: Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 HTTP/1.1 Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4nDHzBnzio2VZ6ciHSRMNEEHFIYRjyMTvKRDfIH2F_niI0FcU0ZqBeBBZkKpUdHOb90TorX284g0qMdisJyL77Y3j06R-x49-mqWZufa0BFWwlg29tIQoalg1p609ZLEly-KDP4mLoxCO4eWlqZVpPuU5-IPf0H50niq4AklVZ208 Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:38:48.853749 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:38:48.855340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cfc86120e53145328dd430f542e73182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cfc86120e53145328dd430f542e73182", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cfc86120e53145328dd430f542e73182"}]}] Aug 08 14:38:48.855340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:48.855340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: cfc86120e53145328dd430f542e73182 Aug 08 14:38:48.855340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113620880 Aug 08 14:38:48.855340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:48.855340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:38:48.855340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:38:48.855340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 48a91f6797cc4604ba2606e0549234d0 Aug 08 14:38:48.855340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-AttachVolumeNegativeTest-2113620880-project Aug 08 14:38:48.855340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:38:48.855340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:38:48.855340 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': '1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70'} Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:48.856149 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. Aug 08 14:38:48.857378 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:48.858502 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bbf5807d-b031-4159-a313-5834f01fb171 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] Returning 404 to user: Instance 1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:48.858502 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bbf5807d-b031-4159-a313-5834f01fb171 tempest-AttachVolumeNegativeTest-2113620880 tempest-AttachVolumeNegativeTest-2113620880-project] 10.222.0.50 "GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70" status: 404 len: 111 microversion: 2.1 time: 0.031648 Aug 08 14:38:48.858502 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 620/1191] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:38:48 2022] GET /compute/v2.1/servers/1b4d1d67-fcd8-4dba-a6b0-8562ce1d3d70 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:38:49.078358 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-51e6c09d-659c-4082-8c12-d9b1698b983a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:49.078962 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-51e6c09d-659c-4082-8c12-d9b1698b983a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:49.085242 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51e6c09d-659c-4082-8c12-d9b1698b983a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:49.085989 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51e6c09d-659c-4082-8c12-d9b1698b983a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:49.087512 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51e6c09d-659c-4082-8c12-d9b1698b983a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:49.088258 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51e6c09d-659c-4082-8c12-d9b1698b983a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:49.088718 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51e6c09d-659c-4082-8c12-d9b1698b983a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:49.089149 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51e6c09d-659c-4082-8c12-d9b1698b983a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:49.226419 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-51e6c09d-659c-4082-8c12-d9b1698b983a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:49.235749 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-51e6c09d-659c-4082-8c12-d9b1698b983a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:49.237550 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-51e6c09d-659c-4082-8c12-d9b1698b983a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:49.238727 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-51e6c09d-659c-4082-8c12-d9b1698b983a tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1723 microversion: 2.20 time: 0.164327 Aug 08 14:38:49.239465 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 572/1192] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:38:49 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:38:50.266079 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-ecd8ac7f-9068-4936-a53c-accc03516e96 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:50.267328 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-ecd8ac7f-9068-4936-a53c-accc03516e96 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:50.274953 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ecd8ac7f-9068-4936-a53c-accc03516e96 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:50.275752 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ecd8ac7f-9068-4936-a53c-accc03516e96 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:50.276202 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ecd8ac7f-9068-4936-a53c-accc03516e96 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:50.276921 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ecd8ac7f-9068-4936-a53c-accc03516e96 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:50.277383 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ecd8ac7f-9068-4936-a53c-accc03516e96 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:50.277811 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-ecd8ac7f-9068-4936-a53c-accc03516e96 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:50.364218 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ecd8ac7f-9068-4936-a53c-accc03516e96 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:50.381141 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ecd8ac7f-9068-4936-a53c-accc03516e96 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:50.381814 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-ecd8ac7f-9068-4936-a53c-accc03516e96 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d2f3c3c5fb4cceabf9a35f64a1551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2ecaeb6faf4c1ea5eac70b19398b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:38:50.382418 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-ecd8ac7f-9068-4936-a53c-accc03516e96 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 200 len: 1655 microversion: 2.20 time: 0.123239 Aug 08 14:38:50.383067 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 621/1193] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:38:50 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 1655 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 14:38:50.455794 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-aa248628-5d8c-4045-b704-b9c5d2afdb89 req-14174a5e-2008-4a56-8615-9c3c3dff35a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79aaf7b-bbdb-42b5-a337-89102612ff93", "name": "network-vif-deleted", "tag": "9bfd7cef-c545-4cf2-8212-293910501379"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:38:50.469629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-aa248628-5d8c-4045-b704-b9c5d2afdb89 req-14174a5e-2008-4a56-8615-9c3c3dff35a1 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:50.470818 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-aa248628-5d8c-4045-b704-b9c5d2afdb89 req-14174a5e-2008-4a56-8615-9c3c3dff35a1 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:50.471533 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-aa248628-5d8c-4045-b704-b9c5d2afdb89 req-14174a5e-2008-4a56-8615-9c3c3dff35a1 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:50.494245 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-aa248628-5d8c-4045-b704-b9c5d2afdb89 req-14174a5e-2008-4a56-8615-9c3c3dff35a1 service nova] Creating event network-vif-deleted:9bfd7cef-c545-4cf2-8212-293910501379 for instance c79aaf7b-bbdb-42b5-a337-89102612ff93 on hv-cinder-85200 Aug 08 14:38:50.505281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-aa248628-5d8c-4045-b704-b9c5d2afdb89 req-14174a5e-2008-4a56-8615-9c3c3dff35a1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056381 Aug 08 14:38:50.509290 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 573/1194] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:38:51.405991 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f63eb52f-cf1d-45ec-85a9-b09101287468 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:51.406473 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f63eb52f-cf1d-45ec-85a9-b09101287468 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:51.415319 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f63eb52f-cf1d-45ec-85a9-b09101287468 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:51.418524 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f63eb52f-cf1d-45ec-85a9-b09101287468 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:51.418981 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f63eb52f-cf1d-45ec-85a9-b09101287468 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:51.419758 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f63eb52f-cf1d-45ec-85a9-b09101287468 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:51.420223 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f63eb52f-cf1d-45ec-85a9-b09101287468 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:51.420653 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f63eb52f-cf1d-45ec-85a9-b09101287468 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:51.438548 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-f63eb52f-cf1d-45ec-85a9-b09101287468 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] HTTP exception thrown: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f63eb52f-cf1d-45ec-85a9-b09101287468 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Request method failure captured: Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 HTTP/1.1 Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4eFRQxVL1NY3_tx_qiqxwLmZrSvOeRyO8y9Q4-ETjuT7myDyeuwE3LKjiXygw__BMoz7NpPBYCZhi6Sbk7IzqYL1uEBrHZpteZsX4u-VuWdTzcEZMq581XIJ38xWOfnxo0KPoNJtai0-08vQPq9qLGHpD9ujQHSnZ4RX2KelrCBkk Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: fa2ecaeb6faf4c1ea5eac70b19398b42 Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:38:51.440160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:38:51.441561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fa2ecaeb6faf4c1ea5eac70b19398b42", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}] Aug 08 14:38:51.441561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:51.441561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: fa2ecaeb6faf4c1ea5eac70b19398b42 Aug 08 14:38:51.441561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:51.441561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-AttachVolumeShelveTestJSON-290340830-project Aug 08 14:38:51.441561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:38:51.441561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:38:51.441561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 84d2f3c3c5fb4cceabf9a35f64a1551c Aug 08 14:38:51.441561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-AttachVolumeShelveTestJSON-290340830-project Aug 08 14:38:51.441561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:38:51.441561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:51.441561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': 'c79aaf7b-bbdb-42b5-a337-89102612ff93'} Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:51.442819 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:51.444430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:51.447283 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f63eb52f-cf1d-45ec-85a9-b09101287468 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Returning 404 to user: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:51.447283 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f63eb52f-cf1d-45ec-85a9-b09101287468 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 404 len: 111 microversion: 2.20 time: 0.040953 Aug 08 14:38:51.447283 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 622/1195] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:38:51 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 14:38:51.456939 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f23a9e8d-4a9e-4269-993d-670fe4bd6274 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '.version_select at 0x7f9cb259d310>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:51.478922 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f23a9e8d-4a9e-4269-993d-670fe4bd6274 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843379445" status: 204 len: 0 microversion: 2.20 time: 0.031168 Aug 08 14:38:51.479898 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 574/1196] 10.222.0.50 () {60 vars in 1262 bytes} [Mon Aug 8 14:38:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843379445 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 08 14:38:53.431332 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0e8acee5-1b12-4f72-a5f4-72b7152d4da4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:53.431909 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-0e8acee5-1b12-4f72-a5f4-72b7152d4da4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:53.438212 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0e8acee5-1b12-4f72-a5f4-72b7152d4da4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:53.438680 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0e8acee5-1b12-4f72-a5f4-72b7152d4da4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:53.439135 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0e8acee5-1b12-4f72-a5f4-72b7152d4da4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:53.439824 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0e8acee5-1b12-4f72-a5f4-72b7152d4da4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:53.440274 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0e8acee5-1b12-4f72-a5f4-72b7152d4da4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:53.440691 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-0e8acee5-1b12-4f72-a5f4-72b7152d4da4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:53.454638 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-0e8acee5-1b12-4f72-a5f4-72b7152d4da4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] HTTP exception thrown: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0e8acee5-1b12-4f72-a5f4-72b7152d4da4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Request method failure captured: Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: DELETE /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 HTTP/1.1 Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4eFRQxVL1NY3_tx_qiqxwLmZrSvOeRyO8y9Q4-ETjuT7myDyeuwE3LKjiXygw__BMoz7NpPBYCZhi6Sbk7IzqYL1uEBrHZpteZsX4u-VuWdTzcEZMq581XIJ38xWOfnxo0KPoNJtai0-08vQPq9qLGHpD9ujQHSnZ4RX2KelrCBkk Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: fa2ecaeb6faf4c1ea5eac70b19398b42 Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:38:53.456160 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:38:53.457592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fa2ecaeb6faf4c1ea5eac70b19398b42", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}] Aug 08 14:38:53.457592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:53.457592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: fa2ecaeb6faf4c1ea5eac70b19398b42 Aug 08 14:38:53.457592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:53.457592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-AttachVolumeShelveTestJSON-290340830-project Aug 08 14:38:53.457592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:38:53.457592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:38:53.457592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 84d2f3c3c5fb4cceabf9a35f64a1551c Aug 08 14:38:53.457592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-AttachVolumeShelveTestJSON-290340830-project Aug 08 14:38:53.457592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:38:53.457592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:53.457592 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': 'c79aaf7b-bbdb-42b5-a337-89102612ff93'} Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:53.458355 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:53.460114 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:53.461663 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-0e8acee5-1b12-4f72-a5f4-72b7152d4da4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Returning 404 to user: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:53.461663 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-0e8acee5-1b12-4f72-a5f4-72b7152d4da4 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 404 len: 111 microversion: 2.20 time: 0.030641 Aug 08 14:38:53.461663 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 623/1197] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Aug 8 14:38:53 2022] DELETE /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 14:38:53.466351 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-71458a95-4b76-45cf-b3ff-67fbf22cc51e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:53.467160 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-71458a95-4b76-45cf-b3ff-67fbf22cc51e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: c79aaf7b-bbdb-42b5-a337-89102612ff93] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:53.474274 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-71458a95-4b76-45cf-b3ff-67fbf22cc51e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:53.474753 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-71458a95-4b76-45cf-b3ff-67fbf22cc51e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:53.475213 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-71458a95-4b76-45cf-b3ff-67fbf22cc51e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:53.475911 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-71458a95-4b76-45cf-b3ff-67fbf22cc51e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:53.476451 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-71458a95-4b76-45cf-b3ff-67fbf22cc51e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:53.476879 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-71458a95-4b76-45cf-b3ff-67fbf22cc51e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:53.490057 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-71458a95-4b76-45cf-b3ff-67fbf22cc51e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] HTTP exception thrown: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-71458a95-4b76-45cf-b3ff-67fbf22cc51e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Request method failure captured: Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 HTTP/1.1 Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4eFRQxVL1NY3_tx_qiqxwLmZrSvOeRyO8y9Q4-ETjuT7myDyeuwE3LKjiXygw__BMoz7NpPBYCZhi6Sbk7IzqYL1uEBrHZpteZsX4u-VuWdTzcEZMq581XIJ38xWOfnxo0KPoNJtai0-08vQPq9qLGHpD9ujQHSnZ4RX2KelrCBkk Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: fa2ecaeb6faf4c1ea5eac70b19398b42 Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:38:53.491716 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:38:53.493921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fa2ecaeb6faf4c1ea5eac70b19398b42", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}] Aug 08 14:38:53.493921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:53.493921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: fa2ecaeb6faf4c1ea5eac70b19398b42 Aug 08 14:38:53.493921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:53.493921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeShelveTestJSON-290340830-project Aug 08 14:38:53.493921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:38:53.493921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:38:53.493921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 84d2f3c3c5fb4cceabf9a35f64a1551c Aug 08 14:38:53.493921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeShelveTestJSON-290340830-project Aug 08 14:38:53.493921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:38:53.493921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:53.493921 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'c79aaf7b-bbdb-42b5-a337-89102612ff93'} Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:53.494739 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. Aug 08 14:38:53.496225 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:53.497718 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-71458a95-4b76-45cf-b3ff-67fbf22cc51e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Returning 404 to user: Instance c79aaf7b-bbdb-42b5-a337-89102612ff93 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:53.497718 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-71458a95-4b76-45cf-b3ff-67fbf22cc51e tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93" status: 404 len: 111 microversion: 2.20 time: 0.031222 Aug 08 14:38:53.497718 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 575/1198] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:38:53 2022] GET /compute/v2.1/servers/c79aaf7b-bbdb-42b5-a337-89102612ff93 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 14:38:54.631699 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5e5de817-5fa0-46bc-859e-9762643fe949 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:54.632312 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-5e5de817-5fa0-46bc-859e-9762643fe949 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:54.639217 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e5de817-5fa0-46bc-859e-9762643fe949 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:54.639790 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e5de817-5fa0-46bc-859e-9762643fe949 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:54.640413 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e5de817-5fa0-46bc-859e-9762643fe949 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:54.641208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e5de817-5fa0-46bc-859e-9762643fe949 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:54.641574 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e5de817-5fa0-46bc-859e-9762643fe949 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:54.642092 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-5e5de817-5fa0-46bc-859e-9762643fe949 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:54.657502 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-5e5de817-5fa0-46bc-859e-9762643fe949 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] HTTP exception thrown: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5e5de817-5fa0-46bc-859e-9762643fe949 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Request method failure captured: Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: DELETE /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c HTTP/1.1 Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R4eFRQxVL1NY3_tx_qiqxwLmZrSvOeRyO8y9Q4-ETjuT7myDyeuwE3LKjiXygw__BMoz7NpPBYCZhi6Sbk7IzqYL1uEBrHZpteZsX4u-VuWdTzcEZMq581XIJ38xWOfnxo0KPoNJtai0-08vQPq9qLGHpD9ujQHSnZ4RX2KelrCBkk Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: fa2ecaeb6faf4c1ea5eac70b19398b42 Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:38:54.659210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:38:54.661129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fa2ecaeb6faf4c1ea5eac70b19398b42", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}] Aug 08 14:38:54.661129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:54.661129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: fa2ecaeb6faf4c1ea5eac70b19398b42 Aug 08 14:38:54.661129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:54.661129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-AttachVolumeShelveTestJSON-290340830-project Aug 08 14:38:54.661129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:38:54.661129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:38:54.661129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 84d2f3c3c5fb4cceabf9a35f64a1551c Aug 08 14:38:54.661129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-AttachVolumeShelveTestJSON-290340830-project Aug 08 14:38:54.661129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:38:54.661129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:38:54.661129 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': 'fd0245e7-b0d0-4fbe-a233-4b3e7768b94c'} Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:54.662034 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:38:54.663307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:38:54.665086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-5e5de817-5fa0-46bc-859e-9762643fe949 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Returning 404 to user: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:54.665086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-5e5de817-5fa0-46bc-859e-9762643fe949 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 404 len: 111 microversion: 2.20 time: 0.033230 Aug 08 14:38:54.665086 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 624/1199] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Aug 8 14:38:54 2022] DELETE /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 14:38:54.669970 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-cd042ebd-8c92-4ec8-ba5e-a583d5bd74a9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:38:54.670733 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-cd042ebd-8c92-4ec8-ba5e-a583d5bd74a9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] [instance: fd0245e7-b0d0-4fbe-a233-4b3e7768b94c] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:38:54.677148 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cd042ebd-8c92-4ec8-ba5e-a583d5bd74a9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:54.677631 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cd042ebd-8c92-4ec8-ba5e-a583d5bd74a9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:54.678072 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cd042ebd-8c92-4ec8-ba5e-a583d5bd74a9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:54.678779 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cd042ebd-8c92-4ec8-ba5e-a583d5bd74a9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:38:54.679343 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cd042ebd-8c92-4ec8-ba5e-a583d5bd74a9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:38:54.680282 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cd042ebd-8c92-4ec8-ba5e-a583d5bd74a9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:38:54.694526 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-cd042ebd-8c92-4ec8-ba5e-a583d5bd74a9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] HTTP exception thrown: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-cd042ebd-8c92-4ec8-ba5e-a583d5bd74a9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Request method failure captured: Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c HTTP/1.1 Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R4eFRQxVL1NY3_tx_qiqxwLmZrSvOeRyO8y9Q4-ETjuT7myDyeuwE3LKjiXygw__BMoz7NpPBYCZhi6Sbk7IzqYL1uEBrHZpteZsX4u-VuWdTzcEZMq581XIJ38xWOfnxo0KPoNJtai0-08vQPq9qLGHpD9ujQHSnZ4RX2KelrCBkk Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: fa2ecaeb6faf4c1ea5eac70b19398b42 Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:38:54.696295 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:38:54.698249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fa2ecaeb6faf4c1ea5eac70b19398b42", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa2ecaeb6faf4c1ea5eac70b19398b42"}]}] Aug 08 14:38:54.698249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:54.698249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: fa2ecaeb6faf4c1ea5eac70b19398b42 Aug 08 14:38:54.698249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-290340830 Aug 08 14:38:54.698249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeShelveTestJSON-290340830-project Aug 08 14:38:54.698249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:38:54.698249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:38:54.698249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 84d2f3c3c5fb4cceabf9a35f64a1551c Aug 08 14:38:54.698249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeShelveTestJSON-290340830-project Aug 08 14:38:54.698249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:38:54.698249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:38:54.698249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'fd0245e7-b0d0-4fbe-a233-4b3e7768b94c'} Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:38:54.699196 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. Aug 08 14:38:54.700536 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:38:54.701748 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-cd042ebd-8c92-4ec8-ba5e-a583d5bd74a9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] Returning 404 to user: Instance fd0245e7-b0d0-4fbe-a233-4b3e7768b94c could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:38:54.701748 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-cd042ebd-8c92-4ec8-ba5e-a583d5bd74a9 tempest-AttachVolumeShelveTestJSON-290340830 tempest-AttachVolumeShelveTestJSON-290340830-project] 10.222.0.50 "GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c" status: 404 len: 111 microversion: 2.20 time: 0.031843 Aug 08 14:38:54.701748 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 576/1200] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 14:38:54 2022] GET /compute/v2.1/servers/fd0245e7-b0d0-4fbe-a233-4b3e7768b94c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 14:39:23.137291 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f54e3dd4-c9c3-44b8-b3fc-83ce85f073a8 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:39:23.137808 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f54e3dd4-c9c3-44b8-b3fc-83ce85f073a8 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:39:23.141981 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-0afe1ecb-b59a-4297-8863-bae30c7d0b93 req-768db176-90c7-45ba-aa0a-ef70b326814a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eff17af-e081-4582-82fb-ba2f7a45c338", "tag": "54289b72-3379-4dba-9ae7-835b040e581b"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:39:23.143799 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=49 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:39:23.145109 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=14 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:39:23.147011 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f54e3dd4-c9c3-44b8-b3fc-83ce85f073a8 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:39:23.147772 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f54e3dd4-c9c3-44b8-b3fc-83ce85f073a8 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:39:23.148471 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f54e3dd4-c9c3-44b8-b3fc-83ce85f073a8 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:39:23.149531 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f54e3dd4-c9c3-44b8-b3fc-83ce85f073a8 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:39:23.150040 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:39:23.150903 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f54e3dd4-c9c3-44b8-b3fc-83ce85f073a8 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:39:23.151585 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:39:23.151989 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f54e3dd4-c9c3-44b8-b3fc-83ce85f073a8 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:39:23.157612 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0afe1ecb-b59a-4297-8863-bae30c7d0b93 req-768db176-90c7-45ba-aa0a-ef70b326814a service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:39:23.158483 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0afe1ecb-b59a-4297-8863-bae30c7d0b93 req-768db176-90c7-45ba-aa0a-ef70b326814a service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:39:23.159543 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0afe1ecb-b59a-4297-8863-bae30c7d0b93 req-768db176-90c7-45ba-aa0a-ef70b326814a service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:39:23.176456 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-0afe1ecb-b59a-4297-8863-bae30c7d0b93 req-768db176-90c7-45ba-aa0a-ef70b326814a service nova] Creating event network-changed:54289b72-3379-4dba-9ae7-835b040e581b for instance 0eff17af-e081-4582-82fb-ba2f7a45c338 on hv-cinder-85200 Aug 08 14:39:23.182960 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-0afe1ecb-b59a-4297-8863-bae30c7d0b93 req-768db176-90c7-45ba-aa0a-ef70b326814a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046369 Aug 08 14:39:23.184517 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 577/1201] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:39:23.184783 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f54e3dd4-c9c3-44b8-b3fc-83ce85f073a8 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Going to try to terminate instance {{(pid=118062) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:39:23.300002 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f54e3dd4-c9c3-44b8-b3fc-83ce85f073a8 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 204 len: 0 microversion: 2.1 time: 0.165249 Aug 08 14:39:23.301669 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 625/1202] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:39:23 2022] DELETE /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:39:23.311594 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bd7c721f-c7fe-418f-81ee-fe5983a5de1a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:39:23.312618 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bd7c721f-c7fe-418f-81ee-fe5983a5de1a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:39:23.327786 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bd7c721f-c7fe-418f-81ee-fe5983a5de1a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:39:23.328764 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bd7c721f-c7fe-418f-81ee-fe5983a5de1a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:39:23.329574 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bd7c721f-c7fe-418f-81ee-fe5983a5de1a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:39:23.330523 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bd7c721f-c7fe-418f-81ee-fe5983a5de1a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:39:23.331226 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bd7c721f-c7fe-418f-81ee-fe5983a5de1a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:39:23.333393 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bd7c721f-c7fe-418f-81ee-fe5983a5de1a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:39:23.617239 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bd7c721f-c7fe-418f-81ee-fe5983a5de1a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:39:23.632562 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bd7c721f-c7fe-418f-81ee-fe5983a5de1a tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.325036 Aug 08 14:39:23.652306 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 578/1203] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:39:23 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:39:24.656466 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-71e8b56a-0917-45cc-aca4-02bfffe35685 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:39:24.657325 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-71e8b56a-0917-45cc-aca4-02bfffe35685 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:39:24.664713 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71e8b56a-0917-45cc-aca4-02bfffe35685 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:39:24.665200 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71e8b56a-0917-45cc-aca4-02bfffe35685 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:39:24.665632 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71e8b56a-0917-45cc-aca4-02bfffe35685 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:39:24.666868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71e8b56a-0917-45cc-aca4-02bfffe35685 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:39:24.667354 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71e8b56a-0917-45cc-aca4-02bfffe35685 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:39:24.667777 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71e8b56a-0917-45cc-aca4-02bfffe35685 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:39:24.883500 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-71e8b56a-0917-45cc-aca4-02bfffe35685 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:39:24.884745 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-71e8b56a-0917-45cc-aca4-02bfffe35685 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1569 microversion: 2.1 time: 0.232559 Aug 08 14:39:24.897002 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 626/1204] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:39:24 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:39:25.580267 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-eb62f670-0346-4e6d-ac76-486f7634ad00 req-3248b8ce-72ef-4bef-9f96-3f08226374a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eff17af-e081-4582-82fb-ba2f7a45c338", "name": "network-vif-deleted", "tag": "54289b72-3379-4dba-9ae7-835b040e581b"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:39:25.591836 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-eb62f670-0346-4e6d-ac76-486f7634ad00 req-3248b8ce-72ef-4bef-9f96-3f08226374a7 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:39:25.592405 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-eb62f670-0346-4e6d-ac76-486f7634ad00 req-3248b8ce-72ef-4bef-9f96-3f08226374a7 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:39:25.592854 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-eb62f670-0346-4e6d-ac76-486f7634ad00 req-3248b8ce-72ef-4bef-9f96-3f08226374a7 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:39:25.606007 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-eb62f670-0346-4e6d-ac76-486f7634ad00 req-3248b8ce-72ef-4bef-9f96-3f08226374a7 service nova] Creating event network-vif-deleted:54289b72-3379-4dba-9ae7-835b040e581b for instance 0eff17af-e081-4582-82fb-ba2f7a45c338 on hv-cinder-85200 Aug 08 14:39:25.610935 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-eb62f670-0346-4e6d-ac76-486f7634ad00 req-3248b8ce-72ef-4bef-9f96-3f08226374a7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034310 Aug 08 14:39:25.611569 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 579/1205] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:39:25.908837 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-7bdc4bf3-c8f9-4d01-a82e-0c2224f24752 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:39:25.909830 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-7bdc4bf3-c8f9-4d01-a82e-0c2224f24752 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:39:25.923855 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7bdc4bf3-c8f9-4d01-a82e-0c2224f24752 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:39:25.924646 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7bdc4bf3-c8f9-4d01-a82e-0c2224f24752 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:39:25.925362 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7bdc4bf3-c8f9-4d01-a82e-0c2224f24752 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:39:25.926304 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7bdc4bf3-c8f9-4d01-a82e-0c2224f24752 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:39:25.926760 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7bdc4bf3-c8f9-4d01-a82e-0c2224f24752 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:39:25.927215 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-7bdc4bf3-c8f9-4d01-a82e-0c2224f24752 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:39:25.993255 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-7bdc4bf3-c8f9-4d01-a82e-0c2224f24752 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c376f5bd19c840b7924093606dee6f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0c0d2823dd4a3fb35bb8c0cad4f410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:39:26.001892 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-7bdc4bf3-c8f9-4d01-a82e-0c2224f24752 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 200 len: 1220 microversion: 2.1 time: 0.096988 Aug 08 14:39:26.002470 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 627/1206] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:39:25 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:39:27.022981 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f73ab1cc-d627-4a57-83fe-5e588eb3fca4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:39:27.023700 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f73ab1cc-d627-4a57-83fe-5e588eb3fca4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] [instance: 0eff17af-e081-4582-82fb-ba2f7a45c338] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:39:27.030237 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f73ab1cc-d627-4a57-83fe-5e588eb3fca4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:39:27.030718 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f73ab1cc-d627-4a57-83fe-5e588eb3fca4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:39:27.031170 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f73ab1cc-d627-4a57-83fe-5e588eb3fca4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:39:27.031859 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f73ab1cc-d627-4a57-83fe-5e588eb3fca4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:39:27.032309 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f73ab1cc-d627-4a57-83fe-5e588eb3fca4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:39:27.032734 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f73ab1cc-d627-4a57-83fe-5e588eb3fca4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:39:27.046629 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-f73ab1cc-d627-4a57-83fe-5e588eb3fca4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] HTTP exception thrown: Instance 0eff17af-e081-4582-82fb-ba2f7a45c338 could not be found. Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f73ab1cc-d627-4a57-83fe-5e588eb3fca4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Request method failure captured: Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 HTTP/1.1 Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R6zMxdGpan5kEiKAAplwZ34hafTC7oe3mQ_l7ZWWsqb1RfhMmwHUD2TqFCqh78ei28CoZwxszl3LwDPRN4A66nOZdC-B_xkbZ5dVeiHkygvclq3NI6Ex95RGoXZ3WNdLbjXf1-qPoBN-daVtjLi1kwVJNvUhtgjGVG7TmZfwfgllrE Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: fb0c0d2823dd4a3fb35bb8c0cad4f410 Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-TestShelveInstance-1815422715 Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:39:27.048281 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:39:27.050042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fb0c0d2823dd4a3fb35bb8c0cad4f410"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fb0c0d2823dd4a3fb35bb8c0cad4f410", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb0c0d2823dd4a3fb35bb8c0cad4f410"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb0c0d2823dd4a3fb35bb8c0cad4f410"}]}] Aug 08 14:39:27.050042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-TestShelveInstance-1815422715 Aug 08 14:39:27.050042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: fb0c0d2823dd4a3fb35bb8c0cad4f410 Aug 08 14:39:27.050042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-TestShelveInstance-1815422715 Aug 08 14:39:27.050042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-TestShelveInstance-1815422715-project Aug 08 14:39:27.050042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:39:27.050042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:39:27.050042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: c376f5bd19c840b7924093606dee6f4f Aug 08 14:39:27.050042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-TestShelveInstance-1815422715-project Aug 08 14:39:27.050042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:39:27.050042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance 0eff17af-e081-4582-82fb-ba2f7a45c338 could not be found. Aug 08 14:39:27.050042 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '0eff17af-e081-4582-82fb-ba2f7a45c338'} Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eff17af-e081-4582-82fb-ba2f7a45c338 could not be found. Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:39:27.050975 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eff17af-e081-4582-82fb-ba2f7a45c338 could not be found. Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eff17af-e081-4582-82fb-ba2f7a45c338 could not be found. Aug 08 14:39:27.052601 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:39:27.054051 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f73ab1cc-d627-4a57-83fe-5e588eb3fca4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Returning 404 to user: Instance 0eff17af-e081-4582-82fb-ba2f7a45c338 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:39:27.054051 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f73ab1cc-d627-4a57-83fe-5e588eb3fca4 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338" status: 404 len: 111 microversion: 2.1 time: 0.031347 Aug 08 14:39:27.054051 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 580/1207] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:39:27 2022] GET /compute/v2.1/servers/0eff17af-e081-4582-82fb-ba2f7a45c338 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:39:27.524858 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-bc852de7-da89-42a7-b188-804f8bc5a4f1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] Calling method '.version_select at 0x7f9cb24ff790>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:39:27.548275 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-bc852de7-da89-42a7-b188-804f8bc5a4f1 tempest-TestShelveInstance-1815422715 tempest-TestShelveInstance-1815422715-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1152802890" status: 202 len: 0 microversion: 2.1 time: 0.027214 Aug 08 14:39:27.549068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 628/1208] 10.222.0.50 () {58 vars in 1254 bytes} [Mon Aug 8 14:39:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1152802890 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:40:41.878366 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=8 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:40:41.880129 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=12 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:40:41.881716 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:40:41.882664 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG dbcounter [-] [118062] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 14:40:41.885849 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-242dff78-920e-4d97-b13a-273321459933 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:41.886604 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-242dff78-920e-4d97-b13a-273321459933 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:41.887638 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-0b96221d-19f9-4fba-a961-9a57e4d4865b req-87feb707-b107-4181-b236-0e2b22c256ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb071f46-f292-43de-9abd-e7efc9dd3616", "tag": "94bc8ac2-a326-4398-855d-d7aa05a32d8d"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:40:41.894198 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-242dff78-920e-4d97-b13a-273321459933 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:41.895072 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-242dff78-920e-4d97-b13a-273321459933 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:41.895858 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-242dff78-920e-4d97-b13a-273321459933 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:41.896643 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-242dff78-920e-4d97-b13a-273321459933 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:41.897182 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-242dff78-920e-4d97-b13a-273321459933 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:41.897685 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-242dff78-920e-4d97-b13a-273321459933 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:41.901179 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-0b96221d-19f9-4fba-a961-9a57e4d4865b req-87feb707-b107-4181-b236-0e2b22c256ad service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:41.901702 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-0b96221d-19f9-4fba-a961-9a57e4d4865b req-87feb707-b107-4181-b236-0e2b22c256ad service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:41.902500 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-0b96221d-19f9-4fba-a961-9a57e4d4865b req-87feb707-b107-4181-b236-0e2b22c256ad service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:41.916208 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-0b96221d-19f9-4fba-a961-9a57e4d4865b req-87feb707-b107-4181-b236-0e2b22c256ad service nova] Creating event network-changed:94bc8ac2-a326-4398-855d-d7aa05a32d8d for instance eb071f46-f292-43de-9abd-e7efc9dd3616 on hv-cinder-85200 Aug 08 14:40:41.923177 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-0b96221d-19f9-4fba-a961-9a57e4d4865b req-87feb707-b107-4181-b236-0e2b22c256ad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043981 Aug 08 14:40:41.924449 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 629/1209] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:40:41.926256 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-242dff78-920e-4d97-b13a-273321459933 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:40:42.002566 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-242dff78-920e-4d97-b13a-273321459933 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "DELETE /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 204 len: 0 microversion: 2.1 time: 0.125744 Aug 08 14:40:42.003079 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 581/1210] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:40:41 2022] DELETE /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:40:42.012630 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-eb29354b-ff18-446e-b1df-dcc3436dbb7f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:42.013334 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-eb29354b-ff18-446e-b1df-dcc3436dbb7f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:42.020489 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb29354b-ff18-446e-b1df-dcc3436dbb7f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:42.020976 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb29354b-ff18-446e-b1df-dcc3436dbb7f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:42.021416 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb29354b-ff18-446e-b1df-dcc3436dbb7f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:42.022126 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb29354b-ff18-446e-b1df-dcc3436dbb7f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:42.022578 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb29354b-ff18-446e-b1df-dcc3436dbb7f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:42.023000 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-eb29354b-ff18-446e-b1df-dcc3436dbb7f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:42.158678 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-eb29354b-ff18-446e-b1df-dcc3436dbb7f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:40:42.166258 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-eb29354b-ff18-446e-b1df-dcc3436dbb7f tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1576 microversion: 2.1 time: 0.158494 Aug 08 14:40:42.166826 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 630/1211] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:40:42 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:40:43.190076 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8d93faf6-96ed-4d16-b2eb-005f536e76c6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:43.190776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8d93faf6-96ed-4d16-b2eb-005f536e76c6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:43.197537 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d93faf6-96ed-4d16-b2eb-005f536e76c6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:43.198017 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d93faf6-96ed-4d16-b2eb-005f536e76c6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:43.198480 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d93faf6-96ed-4d16-b2eb-005f536e76c6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:43.199211 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d93faf6-96ed-4d16-b2eb-005f536e76c6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:43.199668 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d93faf6-96ed-4d16-b2eb-005f536e76c6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:43.200098 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d93faf6-96ed-4d16-b2eb-005f536e76c6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:43.335607 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8d93faf6-96ed-4d16-b2eb-005f536e76c6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:40:43.343029 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8d93faf6-96ed-4d16-b2eb-005f536e76c6 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1576 microversion: 2.1 time: 0.158104 Aug 08 14:40:43.343618 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 582/1212] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:40:43 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:40:44.363569 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d26c9d68-f4cc-4390-a53f-cda3e1841ce5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:44.364176 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d26c9d68-f4cc-4390-a53f-cda3e1841ce5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:44.370526 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d26c9d68-f4cc-4390-a53f-cda3e1841ce5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:44.371003 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d26c9d68-f4cc-4390-a53f-cda3e1841ce5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:44.371516 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d26c9d68-f4cc-4390-a53f-cda3e1841ce5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:44.372210 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d26c9d68-f4cc-4390-a53f-cda3e1841ce5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:44.373152 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d26c9d68-f4cc-4390-a53f-cda3e1841ce5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:44.373598 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d26c9d68-f4cc-4390-a53f-cda3e1841ce5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:44.505570 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d26c9d68-f4cc-4390-a53f-cda3e1841ce5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:40:44.512931 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d26c9d68-f4cc-4390-a53f-cda3e1841ce5 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1576 microversion: 2.1 time: 0.153312 Aug 08 14:40:44.513534 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 631/1213] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:40:44 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:40:45.534836 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-62bf1920-725e-4ab4-a875-41d522be311b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:45.535397 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-62bf1920-725e-4ab4-a875-41d522be311b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:45.541970 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62bf1920-725e-4ab4-a875-41d522be311b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:45.542440 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62bf1920-725e-4ab4-a875-41d522be311b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:45.542870 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62bf1920-725e-4ab4-a875-41d522be311b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:45.543577 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62bf1920-725e-4ab4-a875-41d522be311b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:45.544018 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62bf1920-725e-4ab4-a875-41d522be311b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:45.544442 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62bf1920-725e-4ab4-a875-41d522be311b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:45.681769 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-62bf1920-725e-4ab4-a875-41d522be311b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:40:45.689904 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-62bf1920-725e-4ab4-a875-41d522be311b tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1576 microversion: 2.1 time: 0.159357 Aug 08 14:40:45.690459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 583/1214] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:40:45 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:40:46.711637 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d471fd34-bc90-4782-9887-596b6dd914eb tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:46.712025 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d471fd34-bc90-4782-9887-596b6dd914eb tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:46.718763 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d471fd34-bc90-4782-9887-596b6dd914eb tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:46.719282 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d471fd34-bc90-4782-9887-596b6dd914eb tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:46.719720 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d471fd34-bc90-4782-9887-596b6dd914eb tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:46.720412 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d471fd34-bc90-4782-9887-596b6dd914eb tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:46.720870 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d471fd34-bc90-4782-9887-596b6dd914eb tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:46.721295 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d471fd34-bc90-4782-9887-596b6dd914eb tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:47.035223 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d471fd34-bc90-4782-9887-596b6dd914eb tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:40:47.042611 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d471fd34-bc90-4782-9887-596b6dd914eb tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1576 microversion: 2.1 time: 0.335291 Aug 08 14:40:47.043185 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 632/1215] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:40:46 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1576 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:40:48.063891 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-559f45b6-50ae-4969-ad8e-cec8b3a02136 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:48.064720 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-559f45b6-50ae-4969-ad8e-cec8b3a02136 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:48.071487 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-559f45b6-50ae-4969-ad8e-cec8b3a02136 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:48.072075 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-559f45b6-50ae-4969-ad8e-cec8b3a02136 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:48.072582 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-559f45b6-50ae-4969-ad8e-cec8b3a02136 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:48.073373 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-559f45b6-50ae-4969-ad8e-cec8b3a02136 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:48.073898 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-559f45b6-50ae-4969-ad8e-cec8b3a02136 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:48.074394 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-559f45b6-50ae-4969-ad8e-cec8b3a02136 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:48.326307 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [req-f763c142-d17d-45d2-942e-38cb03cb0309 req-4de4326f-994f-4213-97e7-58afcbd93342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb071f46-f292-43de-9abd-e7efc9dd3616", "name": "network-vif-unplugged", "status": "completed", "tag": "94bc8ac2-a326-4398-855d-d7aa05a32d8d"}]} {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:40:48.342491 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-f763c142-d17d-45d2-942e-38cb03cb0309 req-4de4326f-994f-4213-97e7-58afcbd93342 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:48.343252 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-f763c142-d17d-45d2-942e-38cb03cb0309 req-4de4326f-994f-4213-97e7-58afcbd93342 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:48.343878 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [req-f763c142-d17d-45d2-942e-38cb03cb0309 req-4de4326f-994f-4213-97e7-58afcbd93342 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:48.355079 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.compute.server_external_events [req-f763c142-d17d-45d2-942e-38cb03cb0309 req-4de4326f-994f-4213-97e7-58afcbd93342 service nova] Creating event network-vif-unplugged:94bc8ac2-a326-4398-855d-d7aa05a32d8d for instance eb071f46-f292-43de-9abd-e7efc9dd3616 on hv-cinder-85200 Aug 08 14:40:48.360701 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [req-f763c142-d17d-45d2-942e-38cb03cb0309 req-4de4326f-994f-4213-97e7-58afcbd93342 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038101 Aug 08 14:40:48.361294 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 633/1216] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 14:40:48.391820 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-559f45b6-50ae-4969-ad8e-cec8b3a02136 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:40:48.400089 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-559f45b6-50ae-4969-ad8e-cec8b3a02136 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1576 microversion: 2.1 time: 0.340638 Aug 08 14:40:48.400961 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 584/1217] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:40:48 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1576 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:40:49.422447 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-1397799b-2098-4e30-8dd7-896454db3fed tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:49.423199 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-1397799b-2098-4e30-8dd7-896454db3fed tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:49.429266 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1397799b-2098-4e30-8dd7-896454db3fed tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:49.429770 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1397799b-2098-4e30-8dd7-896454db3fed tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:49.430209 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1397799b-2098-4e30-8dd7-896454db3fed tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:49.430898 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1397799b-2098-4e30-8dd7-896454db3fed tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:49.431377 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1397799b-2098-4e30-8dd7-896454db3fed tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:49.431802 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-1397799b-2098-4e30-8dd7-896454db3fed tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:49.563258 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-1397799b-2098-4e30-8dd7-896454db3fed tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:40:49.570725 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-1397799b-2098-4e30-8dd7-896454db3fed tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1576 microversion: 2.1 time: 0.152975 Aug 08 14:40:49.571325 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 634/1218] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:40:49 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:40:50.167066 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-958a35c3-17e3-4a82-8ebe-5eb8aa96b079 req-433aeaec-2d41-4cce-b8d8-fdedc58573e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb071f46-f292-43de-9abd-e7efc9dd3616", "name": "network-vif-deleted", "tag": "94bc8ac2-a326-4398-855d-d7aa05a32d8d"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:40:50.177885 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-958a35c3-17e3-4a82-8ebe-5eb8aa96b079 req-433aeaec-2d41-4cce-b8d8-fdedc58573e3 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:50.178349 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-958a35c3-17e3-4a82-8ebe-5eb8aa96b079 req-433aeaec-2d41-4cce-b8d8-fdedc58573e3 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:50.178800 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-958a35c3-17e3-4a82-8ebe-5eb8aa96b079 req-433aeaec-2d41-4cce-b8d8-fdedc58573e3 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:50.189963 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-958a35c3-17e3-4a82-8ebe-5eb8aa96b079 req-433aeaec-2d41-4cce-b8d8-fdedc58573e3 service nova] Creating event network-vif-deleted:94bc8ac2-a326-4398-855d-d7aa05a32d8d for instance eb071f46-f292-43de-9abd-e7efc9dd3616 on hv-cinder-85200 Aug 08 14:40:50.194835 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-958a35c3-17e3-4a82-8ebe-5eb8aa96b079 req-433aeaec-2d41-4cce-b8d8-fdedc58573e3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031500 Aug 08 14:40:50.195479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 585/1219] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:40:50.592997 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-d01f70ba-3adc-4036-9c61-1e2ff427ab3c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:50.593612 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-d01f70ba-3adc-4036-9c61-1e2ff427ab3c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:50.600116 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d01f70ba-3adc-4036-9c61-1e2ff427ab3c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:50.600601 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d01f70ba-3adc-4036-9c61-1e2ff427ab3c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:50.601039 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d01f70ba-3adc-4036-9c61-1e2ff427ab3c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:50.601731 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d01f70ba-3adc-4036-9c61-1e2ff427ab3c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:50.602190 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d01f70ba-3adc-4036-9c61-1e2ff427ab3c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:50.602615 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d01f70ba-3adc-4036-9c61-1e2ff427ab3c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:50.632078 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d01f70ba-3adc-4036-9c61-1e2ff427ab3c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:50.632488 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d01f70ba-3adc-4036-9c61-1e2ff427ab3c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:50.632925 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-d01f70ba-3adc-4036-9c61-1e2ff427ab3c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:50.633368 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-d01f70ba-3adc-4036-9c61-1e2ff427ab3c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lazy-loading 'fault' on Instance uuid eb071f46-f292-43de-9abd-e7efc9dd3616 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:40:50.677325 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-d01f70ba-3adc-4036-9c61-1e2ff427ab3c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:40:50.684614 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-d01f70ba-3adc-4036-9c61-1e2ff427ab3c tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 200 len: 1230 microversion: 2.1 time: 0.096133 Aug 08 14:40:50.685172 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 635/1220] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:40:50 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:40:51.706111 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-aee0148a-4ea3-4cf5-a2a3-ed258905f6cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:51.706798 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-aee0148a-4ea3-4cf5-a2a3-ed258905f6cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: eb071f46-f292-43de-9abd-e7efc9dd3616] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:51.712865 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aee0148a-4ea3-4cf5-a2a3-ed258905f6cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:51.713341 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aee0148a-4ea3-4cf5-a2a3-ed258905f6cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:51.713776 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aee0148a-4ea3-4cf5-a2a3-ed258905f6cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:51.714456 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aee0148a-4ea3-4cf5-a2a3-ed258905f6cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:51.714902 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aee0148a-4ea3-4cf5-a2a3-ed258905f6cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:51.715366 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aee0148a-4ea3-4cf5-a2a3-ed258905f6cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:51.728553 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-aee0148a-4ea3-4cf5-a2a3-ed258905f6cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] HTTP exception thrown: Instance eb071f46-f292-43de-9abd-e7efc9dd3616 could not be found. Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-aee0148a-4ea3-4cf5-a2a3-ed258905f6cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Request method failure captured: Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 HTTP/1.1 Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R5eIkBFBEHPZUzy0jaQRN0EudctGzDamlySkpvuHKye7fIn0zJp_gOVT8CxwBJ-qXab_gIKIgtXukyTNZm9BO0l78eZCj73eycltH3XmsRglEyXez2OWaZt73wjvMQI5QeutNhT6-r0yq6_qt7xkHzkploEop5qFbU_sNEXH0Lvt8s Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 8aac3d3b720c45e8817bda1fe4d2d157 Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:40:51.730133 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:40:51.732638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8aac3d3b720c45e8817bda1fe4d2d157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8aac3d3b720c45e8817bda1fe4d2d157", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8aac3d3b720c45e8817bda1fe4d2d157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8aac3d3b720c45e8817bda1fe4d2d157"}]}] Aug 08 14:40:51.732638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:40:51.732638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 8aac3d3b720c45e8817bda1fe4d2d157 Aug 08 14:40:51.732638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:40:51.732638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-TestVolumeBootPattern-1214714201-project Aug 08 14:40:51.732638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:40:51.732638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:40:51.732638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 2495d3c63dc44049872afb908ca6133b Aug 08 14:40:51.732638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-TestVolumeBootPattern-1214714201-project Aug 08 14:40:51.732638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:40:51.732638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance eb071f46-f292-43de-9abd-e7efc9dd3616 could not be found. Aug 08 14:40:51.732638 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'eb071f46-f292-43de-9abd-e7efc9dd3616'} Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb071f46-f292-43de-9abd-e7efc9dd3616 could not be found. Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:40:51.733633 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb071f46-f292-43de-9abd-e7efc9dd3616 could not be found. Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb071f46-f292-43de-9abd-e7efc9dd3616 could not be found. Aug 08 14:40:51.735323 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:51.736779 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-aee0148a-4ea3-4cf5-a2a3-ed258905f6cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Returning 404 to user: Instance eb071f46-f292-43de-9abd-e7efc9dd3616 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:40:51.736779 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-aee0148a-4ea3-4cf5-a2a3-ed258905f6cc tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616" status: 404 len: 111 microversion: 2.1 time: 0.030082 Aug 08 14:40:51.736779 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 586/1221] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:40:51 2022] GET /compute/v2.1/servers/eb071f46-f292-43de-9abd-e7efc9dd3616 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:40:55.011420 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-71d056bc-19f7-4b08-94a5-eff7d00d2f6d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:55.011924 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-71d056bc-19f7-4b08-94a5-eff7d00d2f6d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:55.018345 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71d056bc-19f7-4b08-94a5-eff7d00d2f6d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:55.018908 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71d056bc-19f7-4b08-94a5-eff7d00d2f6d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:55.019464 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71d056bc-19f7-4b08-94a5-eff7d00d2f6d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:55.019808 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-63089ea4-90f5-4ffe-aeda-26958d36bb4f req-f70658f5-4820-4e21-88a4-bcb9edd00404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb38e896-d3ab-4655-bcec-eef6e42c4de4", "tag": "a2298513-6cdb-40b2-88dd-cf9f7ad6d82e"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:40:55.020584 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71d056bc-19f7-4b08-94a5-eff7d00d2f6d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:55.021231 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71d056bc-19f7-4b08-94a5-eff7d00d2f6d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:55.021729 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-71d056bc-19f7-4b08-94a5-eff7d00d2f6d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:55.029917 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-63089ea4-90f5-4ffe-aeda-26958d36bb4f req-f70658f5-4820-4e21-88a4-bcb9edd00404 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:55.030392 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-63089ea4-90f5-4ffe-aeda-26958d36bb4f req-f70658f5-4820-4e21-88a4-bcb9edd00404 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:55.030821 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-63089ea4-90f5-4ffe-aeda-26958d36bb4f req-f70658f5-4820-4e21-88a4-bcb9edd00404 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:55.042163 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-63089ea4-90f5-4ffe-aeda-26958d36bb4f req-f70658f5-4820-4e21-88a4-bcb9edd00404 service nova] Creating event network-changed:a2298513-6cdb-40b2-88dd-cf9f7ad6d82e for instance bb38e896-d3ab-4655-bcec-eef6e42c4de4 on hv-cinder-85200 Aug 08 14:40:55.047880 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-63089ea4-90f5-4ffe-aeda-26958d36bb4f req-f70658f5-4820-4e21-88a4-bcb9edd00404 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031637 Aug 08 14:40:55.048468 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 587/1222] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:40:55.051672 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-71d056bc-19f7-4b08-94a5-eff7d00d2f6d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Going to try to terminate instance {{(pid=118062) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 14:40:55.133916 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-71d056bc-19f7-4b08-94a5-eff7d00d2f6d tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 204 len: 0 microversion: 2.1 time: 0.126488 Aug 08 14:40:55.137561 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 636/1223] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:40:55 2022] DELETE /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 14:40:55.145631 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-46192f82-3d7e-4efa-b8e6-c734af8802bf tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:55.146684 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-46192f82-3d7e-4efa-b8e6-c734af8802bf tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:55.154581 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-46192f82-3d7e-4efa-b8e6-c734af8802bf tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:55.155354 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-46192f82-3d7e-4efa-b8e6-c734af8802bf tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:55.156050 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-46192f82-3d7e-4efa-b8e6-c734af8802bf tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:55.157249 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-46192f82-3d7e-4efa-b8e6-c734af8802bf tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:55.157942 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-46192f82-3d7e-4efa-b8e6-c734af8802bf tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:55.158579 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-46192f82-3d7e-4efa-b8e6-c734af8802bf tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:55.314927 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-46192f82-3d7e-4efa-b8e6-c734af8802bf tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:40:55.322396 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-46192f82-3d7e-4efa-b8e6-c734af8802bf tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1577 microversion: 2.1 time: 0.182274 Aug 08 14:40:55.322964 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 588/1224] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:40:55 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:40:56.345253 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-3a1fad60-fbd5-440f-af13-2aea7f874ba7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:56.345984 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-3a1fad60-fbd5-440f-af13-2aea7f874ba7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:56.352516 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a1fad60-fbd5-440f-af13-2aea7f874ba7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:56.352998 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a1fad60-fbd5-440f-af13-2aea7f874ba7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:56.353430 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a1fad60-fbd5-440f-af13-2aea7f874ba7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:56.354126 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a1fad60-fbd5-440f-af13-2aea7f874ba7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:56.354574 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a1fad60-fbd5-440f-af13-2aea7f874ba7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:56.354993 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-3a1fad60-fbd5-440f-af13-2aea7f874ba7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:56.580841 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-3a1fad60-fbd5-440f-af13-2aea7f874ba7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:40:56.588578 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-3a1fad60-fbd5-440f-af13-2aea7f874ba7 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1577 microversion: 2.1 time: 0.248080 Aug 08 14:40:56.589636 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 637/1225] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:40:56 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1577 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:40:57.040695 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-39db6c99-7425-4e78-a035-f8003ab97b01 req-f958ccac-7fc2-41f2-8733-af877e3b6073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb38e896-d3ab-4655-bcec-eef6e42c4de4", "name": "network-vif-deleted", "tag": "a2298513-6cdb-40b2-88dd-cf9f7ad6d82e"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 14:40:57.050820 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-39db6c99-7425-4e78-a035-f8003ab97b01 req-f958ccac-7fc2-41f2-8733-af877e3b6073 service nova] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:57.051443 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-39db6c99-7425-4e78-a035-f8003ab97b01 req-f958ccac-7fc2-41f2-8733-af877e3b6073 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:57.052010 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-39db6c99-7425-4e78-a035-f8003ab97b01 req-f958ccac-7fc2-41f2-8733-af877e3b6073 service nova] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:57.063743 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-39db6c99-7425-4e78-a035-f8003ab97b01 req-f958ccac-7fc2-41f2-8733-af877e3b6073 service nova] Creating event network-vif-deleted:a2298513-6cdb-40b2-88dd-cf9f7ad6d82e for instance bb38e896-d3ab-4655-bcec-eef6e42c4de4 on hv-cinder-85200 Aug 08 14:40:57.068373 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-39db6c99-7425-4e78-a035-f8003ab97b01 req-f958ccac-7fc2-41f2-8733-af877e3b6073 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031424 Aug 08 14:40:57.068973 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 589/1226] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 14:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 14:40:57.611135 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-f836211b-db80-4906-8bad-a8625f0b5330 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:57.612050 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-f836211b-db80-4906-8bad-a8625f0b5330 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:57.618572 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f836211b-db80-4906-8bad-a8625f0b5330 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:57.619054 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f836211b-db80-4906-8bad-a8625f0b5330 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:57.619516 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f836211b-db80-4906-8bad-a8625f0b5330 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:57.620205 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f836211b-db80-4906-8bad-a8625f0b5330 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:57.620659 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f836211b-db80-4906-8bad-a8625f0b5330 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:57.621077 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f836211b-db80-4906-8bad-a8625f0b5330 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:57.653468 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f836211b-db80-4906-8bad-a8625f0b5330 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:57.654698 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f836211b-db80-4906-8bad-a8625f0b5330 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:57.655156 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-f836211b-db80-4906-8bad-a8625f0b5330 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:57.655598 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.objects.instance [None req-f836211b-db80-4906-8bad-a8625f0b5330 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lazy-loading 'fault' on Instance uuid bb38e896-d3ab-4655-bcec-eef6e42c4de4 {{(pid=118062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 14:40:57.696760 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.policy [None req-f836211b-db80-4906-8bad-a8625f0b5330 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495d3c63dc44049872afb908ca6133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aac3d3b720c45e8817bda1fe4d2d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 14:40:57.703506 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-f836211b-db80-4906-8bad-a8625f0b5330 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 200 len: 1185 microversion: 2.1 time: 0.097246 Aug 08 14:40:57.704068 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 638/1227] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:40:57 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 1185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 14:40:58.725440 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fc146005-ee32-4105-aa8a-5f9fb7dcdf88 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:58.726166 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fc146005-ee32-4105-aa8a-5f9fb7dcdf88 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: bb38e896-d3ab-4655-bcec-eef6e42c4de4] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:58.732860 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc146005-ee32-4105-aa8a-5f9fb7dcdf88 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:58.733340 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc146005-ee32-4105-aa8a-5f9fb7dcdf88 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:58.733774 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc146005-ee32-4105-aa8a-5f9fb7dcdf88 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:58.734465 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc146005-ee32-4105-aa8a-5f9fb7dcdf88 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:58.734918 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc146005-ee32-4105-aa8a-5f9fb7dcdf88 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:58.735376 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc146005-ee32-4105-aa8a-5f9fb7dcdf88 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:58.750048 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-fc146005-ee32-4105-aa8a-5f9fb7dcdf88 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] HTTP exception thrown: Instance bb38e896-d3ab-4655-bcec-eef6e42c4de4 could not be found. Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fc146005-ee32-4105-aa8a-5f9fb7dcdf88 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Request method failure captured: Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 HTTP/1.1 Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R5eIkBFBEHPZUzy0jaQRN0EudctGzDamlySkpvuHKye7fIn0zJp_gOVT8CxwBJ-qXab_gIKIgtXukyTNZm9BO0l78eZCj73eycltH3XmsRglEyXez2OWaZt73wjvMQI5QeutNhT6-r0yq6_qt7xkHzkploEop5qFbU_sNEXH0Lvt8s Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 8aac3d3b720c45e8817bda1fe4d2d157 Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:40:58.751676 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:40:58.753427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8aac3d3b720c45e8817bda1fe4d2d157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8aac3d3b720c45e8817bda1fe4d2d157", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8aac3d3b720c45e8817bda1fe4d2d157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8aac3d3b720c45e8817bda1fe4d2d157"}]}] Aug 08 14:40:58.753427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:40:58.753427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 8aac3d3b720c45e8817bda1fe4d2d157 Aug 08 14:40:58.753427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:40:58.753427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-TestVolumeBootPattern-1214714201-project Aug 08 14:40:58.753427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:40:58.753427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:40:58.753427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 2495d3c63dc44049872afb908ca6133b Aug 08 14:40:58.753427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-TestVolumeBootPattern-1214714201-project Aug 08 14:40:58.753427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:40:58.753427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance bb38e896-d3ab-4655-bcec-eef6e42c4de4 could not be found. Aug 08 14:40:58.753427 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'bb38e896-d3ab-4655-bcec-eef6e42c4de4'} Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb38e896-d3ab-4655-bcec-eef6e42c4de4 could not be found. Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:40:58.754527 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb38e896-d3ab-4655-bcec-eef6e42c4de4 could not be found. Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb38e896-d3ab-4655-bcec-eef6e42c4de4 could not be found. Aug 08 14:40:58.756191 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:58.757984 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fc146005-ee32-4105-aa8a-5f9fb7dcdf88 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Returning 404 to user: Instance bb38e896-d3ab-4655-bcec-eef6e42c4de4 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:40:58.757984 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fc146005-ee32-4105-aa8a-5f9fb7dcdf88 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4" status: 404 len: 111 microversion: 2.1 time: 0.032351 Aug 08 14:40:58.757984 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 590/1228] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:40:58 2022] GET /compute/v2.1/servers/bb38e896-d3ab-4655-bcec-eef6e42c4de4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:40:59.185397 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6739bac2-1770-4edf-8c3e-1d280813ad27 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:59.185927 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.compute.api [None req-6739bac2-1770-4edf-8c3e-1d280813ad27 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118062) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:59.192247 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6739bac2-1770-4edf-8c3e-1d280813ad27 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:59.192723 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6739bac2-1770-4edf-8c3e-1d280813ad27 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:59.193153 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6739bac2-1770-4edf-8c3e-1d280813ad27 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:59.193834 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6739bac2-1770-4edf-8c3e-1d280813ad27 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:59.194293 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6739bac2-1770-4edf-8c3e-1d280813ad27 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:59.194695 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG oslo_concurrency.lockutils [None req-6739bac2-1770-4edf-8c3e-1d280813ad27 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:59.210518 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.wsgi [None req-6739bac2-1770-4edf-8c3e-1d280813ad27 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] HTTP exception thrown: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6739bac2-1770-4edf-8c3e-1d280813ad27 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Request method failure captured: Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: request: DELETE /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a HTTP/1.1 Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept: application/json Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Accept-Encoding: identity Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Connection: close Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Length: 0 Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Content-Type: application/json Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Host: 10.222.0.50 Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Openstack-System-Scope: None Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: User-Agent: python-urllib3/1.26.11 Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Auth-Token: gAAAAABi8R5eIkBFBEHPZUzy0jaQRN0EudctGzDamlySkpvuHKye7fIn0zJp_gOVT8CxwBJ-qXab_gIKIgtXukyTNZm9BO0l78eZCj73eycltH3XmsRglEyXez2OWaZt73wjvMQI5QeutNhT6-r0yq6_qt7xkHzkploEop5qFbU_sNEXH0Lvt8s Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Id: None Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Domain-Name: None Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Identity-Status: Confirmed Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Is-Admin-Project: True Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Id: default Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Domain-Name: Default Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Id: 8aac3d3b720c45e8817bda1fe4d2d157 Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Project-Name: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Role: member,reader Aug 08 14:40:59.212173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Roles: member,reader Aug 08 14:40:59.213868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8aac3d3b720c45e8817bda1fe4d2d157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8aac3d3b720c45e8817bda1fe4d2d157", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8aac3d3b720c45e8817bda1fe4d2d157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8aac3d3b720c45e8817bda1fe4d2d157"}]}] Aug 08 14:40:59.213868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:40:59.213868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Id: 8aac3d3b720c45e8817bda1fe4d2d157 Aug 08 14:40:59.213868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:40:59.213868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User: tempest-TestVolumeBootPattern-1214714201-project Aug 08 14:40:59.213868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Id: default Aug 08 14:40:59.213868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Domain-Name: Default Aug 08 14:40:59.213868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Id: 2495d3c63dc44049872afb908ca6133b Aug 08 14:40:59.213868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: X-User-Name: tempest-TestVolumeBootPattern-1214714201-project Aug 08 14:40:59.213868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: method: > Aug 08 14:40:59.213868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: exception: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:40:59.213868 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: action_args: {'id': 'd4173a09-ab1b-40aa-818f-5954b2c1bc6a'} Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:40:59.214722 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:40:59.216090 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: ERROR nova.api.openstack.wsgi Aug 08 14:40:59.217537 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-6739bac2-1770-4edf-8c3e-1d280813ad27 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Returning 404 to user: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. {{(pid=118062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:40:59.217537 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-6739bac2-1770-4edf-8c3e-1d280813ad27 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 404 len: 111 microversion: 2.1 time: 0.032655 Aug 08 14:40:59.217537 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 639/1229] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 14:40:59 2022] DELETE /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:40:59.222305 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e5ae513d-fea0-411e-90c1-86c89f69a3b8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:40:59.222920 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e5ae513d-fea0-411e-90c1-86c89f69a3b8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] [instance: d4173a09-ab1b-40aa-818f-5954b2c1bc6a] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 14:40:59.228879 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5ae513d-fea0-411e-90c1-86c89f69a3b8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:59.229389 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5ae513d-fea0-411e-90c1-86c89f69a3b8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:59.230026 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5ae513d-fea0-411e-90c1-86c89f69a3b8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:59.230720 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5ae513d-fea0-411e-90c1-86c89f69a3b8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Acquiring lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 14:40:59.231205 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5ae513d-fea0-411e-90c1-86c89f69a3b8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 14:40:59.231635 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5ae513d-fea0-411e-90c1-86c89f69a3b8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Lock "dbc50433-daea-4bbf-a66d-720f9de1a6a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 14:40:59.244753 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-e5ae513d-fea0-411e-90c1-86c89f69a3b8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] HTTP exception thrown: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e5ae513d-fea0-411e-90c1-86c89f69a3b8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Request method failure captured: Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a HTTP/1.1 Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept: application/json Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Connection: close Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.50 Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.11 Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi8R5eIkBFBEHPZUzy0jaQRN0EudctGzDamlySkpvuHKye7fIn0zJp_gOVT8CxwBJ-qXab_gIKIgtXukyTNZm9BO0l78eZCj73eycltH3XmsRglEyXez2OWaZt73wjvMQI5QeutNhT6-r0yq6_qt7xkHzkploEop5qFbU_sNEXH0Lvt8s Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 8aac3d3b720c45e8817bda1fe4d2d157 Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Role: member,reader Aug 08 14:40:59.246263 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Roles: member,reader Aug 08 14:40:59.248479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8aac3d3b720c45e8817bda1fe4d2d157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8aac3d3b720c45e8817bda1fe4d2d157", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8aac3d3b720c45e8817bda1fe4d2d157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8aac3d3b720c45e8817bda1fe4d2d157"}]}] Aug 08 14:40:59.248479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:40:59.248479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 8aac3d3b720c45e8817bda1fe4d2d157 Aug 08 14:40:59.248479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214714201 Aug 08 14:40:59.248479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User: tempest-TestVolumeBootPattern-1214714201-project Aug 08 14:40:59.248479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Aug 08 14:40:59.248479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Aug 08 14:40:59.248479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Id: 2495d3c63dc44049872afb908ca6133b Aug 08 14:40:59.248479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-TestVolumeBootPattern-1214714201-project Aug 08 14:40:59.248479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: method: > Aug 08 14:40:59.248479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: exception: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:40:59.248479 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'd4173a09-ab1b-40aa-818f-5954b2c1bc6a'} Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 14:40:59.249384 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. Aug 08 14:40:59.250705 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Aug 08 14:40:59.252251 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e5ae513d-fea0-411e-90c1-86c89f69a3b8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Returning 404 to user: Instance d4173a09-ab1b-40aa-818f-5954b2c1bc6a could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 14:40:59.252251 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e5ae513d-fea0-411e-90c1-86c89f69a3b8 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a" status: 404 len: 111 microversion: 2.1 time: 0.029858 Aug 08 14:40:59.252251 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 591/1230] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 14:40:59 2022] GET /compute/v2.1/servers/d4173a09-ab1b-40aa-818f-5954b2c1bc6a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 14:41:00.538500 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: DEBUG nova.api.openstack.wsgi [None req-a0eb8ca1-201a-43fd-9889-84f7685cc157 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] Calling method '.version_select at 0x7f9cb26850d0>' {{(pid=118062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 14:41:00.560483 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO nova.api.openstack.requestlog [None req-a0eb8ca1-201a-43fd-9889-84f7685cc157 tempest-TestVolumeBootPattern-1214714201 tempest-TestVolumeBootPattern-1214714201-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1484870203" status: 202 len: 0 microversion: 2.1 time: 0.025149 Aug 08 14:41:00.561173 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: [pid: 118062|app: 0|req: 640/1231] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Aug 8 14:41:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1484870203 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 14:41:00.886459 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:41:00.886960 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Mon Aug 8 14:41:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 14:41:09.011871 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:41:09.012505 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Mon Aug 8 14:41:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 14:42:47.471221 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:42:47.471846 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Mon Aug 8 14:42:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 14:44:15.573551 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:44:15.574322 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Mon Aug 8 14:44:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 14:44:20.895958 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:44:20.896388 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Mon Aug 8 14:44:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 14:44:29.020020 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:44:29.021050 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Mon Aug 8 14:44:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 14:46:07.479861 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:46:07.480645 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Mon Aug 8 14:46:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 14:46:23.519977 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:46:23.520648 dv-cinder-852009-2-iscsi devstack@n-api.service[118062]: Mon Aug 8 14:46:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 14:46:23.696419 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:46:23.696936 dv-cinder-852009-2-iscsi devstack@n-api.service[118060]: Mon Aug 8 14:46:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!